在docker apache storm集群上运行streamparse的问题

vxqlmq5t  于 2021-06-24  发布在  Storm
关注(0)|答案(0)|浏览(313)

我使用提供的示例配置了一个apache storm群集:https://hub.docker.com/_/storm. 我正在尝试将示例python streamparse'wordcount'提交到集群中,但遇到了很多问题。wordcount项目中我的config.json文件见下:

"serializer": "json",
    "topology_specs": "topologies/",
    "virtualenv_specs": "virtualenvs/",
    "envs": {
        "prod": {
            "user": "user",
            "ssh_password": "pass",
            "nimbus": "localhost",
            "workers": ["localhost"],
            "log": {
                "path": "",
                "max_bytes": 1000000,
                "backup_count": 10,
                "level": "info"
            },
            "use_ssh_for_nimbus": true,
            "virtualenv_root": "/stormenvs",
            "use_virtualenv": true
        }
    }
}

下面是我尝试提交时的输出/docker组合:

(wordcount) [root@marshall-dev wordcount]# sparse submit
[localhost] Executing task '_create_or_update_virtualenv'

Warning: Unable to load SSH config file '/root/.ssh/config'

[localhost] virtualenv not found in /stormenvs, creating one.
[localhost] run: virtualenv --never-download /stormenvs/wordcount 

Warning: Unable to load SSH config file '/root/.ssh/config'

Warning: Unable to load SSH config file '/root/.ssh/config'

Warning: Unable to load SSH config file '/root/.ssh/config'

[localhost] out: usage: virtualenv [--version] [--with-traceback] [-v | -q] [--app-data APP_DATA] [--reset-app-data] [--discovery {builtin}] [-p py] [--creator {builtin,cpython3-posix,venv}] [--seeder {app-data,pip}] [--no-seed]
[localhost] out:                   [--activators comma_sep_list] [--clear] [--system-site-packages] [--symlinks | --copies] [--no-download | --download] [--extra-search-dir d [d ...]] [--pip version] [--setuptools version] [--wheel version] [--no-pip]
[localhost] out:                   [--no-setuptools] [--no-wheel] [--symlink-app-data] [--prompt prompt] [-h]
[localhost] out:                   dest
[localhost] out: virtualenv: error: argument dest: the destination . is not write-able at /
[localhost] out: 

Fatal error: run() received nonzero return code 2 while executing!

Requested: virtualenv --never-download /stormenvs/wordcount 
Executed: /bin/bash -l -c "virtualenv --never-download /stormenvs/wordcount "

NoneType: None

Aborting.
Fatal error: One or more hosts failed while executing task '_create_or_update_virtualenv'

Aborting.

--------- docker-compose ----------

services:  
  zookeeper:
    image: zookeeper
    container_name: zookeeper
    restart: always
  nimbus:
    image: storm
    container_name: nimbus
    command: storm nimbus
    depends_on:
      - zookeeper
    links:
      - zookeeper
    restart: always
    ports:
      - 6627:6627
    volumes:
      - "/root/virtualenvs:/stormenvs"
  supervisor:
    image: storm
    container_name: supervisor
    command: storm supervisor
    depends_on:
      - nimbus
      - zookeeper
    links:
      - nimbus
      - zookeeper
    restart: always
    volumes:
      - "/root/virtualenvs:/stormenvs"
  ui:
    image: storm
    container_name: ui
    command: storm ui
    depends_on:
      - nimbus
      - zookeeper
      - supervisor
    links:
      - nimbus
      - zookeeper
      - supervisor
    ports:
      - 8081:8080```
Any help or even a link to a guide on getting python running on apache storm (docker) would be amazing.

Thanks in advance

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题