我使用提供的示例配置了一个apache storm群集:https://hub.docker.com/_/storm. 我正在尝试将示例python streamparse'wordcount'提交到集群中,但遇到了很多问题。wordcount项目中我的config.json文件见下:
"serializer": "json",
"topology_specs": "topologies/",
"virtualenv_specs": "virtualenvs/",
"envs": {
"prod": {
"user": "user",
"ssh_password": "pass",
"nimbus": "localhost",
"workers": ["localhost"],
"log": {
"path": "",
"max_bytes": 1000000,
"backup_count": 10,
"level": "info"
},
"use_ssh_for_nimbus": true,
"virtualenv_root": "/stormenvs",
"use_virtualenv": true
}
}
}
下面是我尝试提交时的输出/docker组合:
(wordcount) [root@marshall-dev wordcount]# sparse submit
[localhost] Executing task '_create_or_update_virtualenv'
Warning: Unable to load SSH config file '/root/.ssh/config'
[localhost] virtualenv not found in /stormenvs, creating one.
[localhost] run: virtualenv --never-download /stormenvs/wordcount
Warning: Unable to load SSH config file '/root/.ssh/config'
Warning: Unable to load SSH config file '/root/.ssh/config'
Warning: Unable to load SSH config file '/root/.ssh/config'
[localhost] out: usage: virtualenv [--version] [--with-traceback] [-v | -q] [--app-data APP_DATA] [--reset-app-data] [--discovery {builtin}] [-p py] [--creator {builtin,cpython3-posix,venv}] [--seeder {app-data,pip}] [--no-seed]
[localhost] out: [--activators comma_sep_list] [--clear] [--system-site-packages] [--symlinks | --copies] [--no-download | --download] [--extra-search-dir d [d ...]] [--pip version] [--setuptools version] [--wheel version] [--no-pip]
[localhost] out: [--no-setuptools] [--no-wheel] [--symlink-app-data] [--prompt prompt] [-h]
[localhost] out: dest
[localhost] out: virtualenv: error: argument dest: the destination . is not write-able at /
[localhost] out:
Fatal error: run() received nonzero return code 2 while executing!
Requested: virtualenv --never-download /stormenvs/wordcount
Executed: /bin/bash -l -c "virtualenv --never-download /stormenvs/wordcount "
NoneType: None
Aborting.
Fatal error: One or more hosts failed while executing task '_create_or_update_virtualenv'
Aborting.
--------- docker-compose ----------
services:
zookeeper:
image: zookeeper
container_name: zookeeper
restart: always
nimbus:
image: storm
container_name: nimbus
command: storm nimbus
depends_on:
- zookeeper
links:
- zookeeper
restart: always
ports:
- 6627:6627
volumes:
- "/root/virtualenvs:/stormenvs"
supervisor:
image: storm
container_name: supervisor
command: storm supervisor
depends_on:
- nimbus
- zookeeper
links:
- nimbus
- zookeeper
restart: always
volumes:
- "/root/virtualenvs:/stormenvs"
ui:
image: storm
container_name: ui
command: storm ui
depends_on:
- nimbus
- zookeeper
- supervisor
links:
- nimbus
- zookeeper
- supervisor
ports:
- 8081:8080```
Any help or even a link to a guide on getting python running on apache storm (docker) would be amazing.
Thanks in advance
暂无答案!
目前还没有任何答案,快来回答吧!