我正在尝试在带有 docker 容器的本地集群上使用 streamparse
这是我的 docker-compose.yml
version: '3'
services:
zookeeper:
image: zookeeper
container_name: zookeeper
nimbus:
image: storm:1.0.2
container_name: nimbus
command: storm nimbus
depends_on:
- zookeeper
supervisor:
image: simsimy/docker-storm-supervisor-with-streamparse
container_name: supervisor
command: storm supervisor
depends_on:
- nimbus
- zookeeper
storm-ui:
image: storm:1.0.2
container_name: storm-ui
command: storm ui
depends_on:
- nimbus
- zookeeper
- supervisor
streamparse 示例开箱即用(使用“sparse quickstart wordcount”命令创建)
我只是在 wordcount 快速入门示例中更改了一些参数以匹配我的风暴版本 1.0.2(在 project.clj 文件中)
顺便说一句,如果你有其他风暴版本的解决方案,我可以改变我的
这是我的 config.json :
{
"serializer": "json",
"topology_specs": "topologies/",
"virtualenv_specs": "virtualenvs/",
"envs": {
"prod": {
"user": "",
"ssh_password": "",
"nimbus": "localhost",
"workers": ["localhost"],
"log": {
"path": "",
"max_bytes": 1000000,
"backup_count": 10,
"level": "info"
},
"use_virtualenv": true,
"virtualenv_root": "/home/myhome/virtualenvs"
}
}
}
./wordcount/virtualenvs/wordcount.txt 仅包含“steamparse”(开箱即用的配置文件)
当我运行稀疏提交时,拓扑失败并显示以下消息:
java.io.IOException: Cannot run program "/home/myhome/virtualenvs/wordcount/bin/streamparse_run" (in directory "/data/supervisor/stormdist/wordcount-10-1529168923/resources")
我检查了 /data/supervisor/stormdist/wordcount-10-1529168923/resources 目录,它只包含 spouts 和 bolts...
拓扑仅在我设置“use_virtualenv”时才有效:false
这是依赖项收集的日志文件: https ://pastebin.com/Tf48kpBb
任何帮助将不胜感激
谢谢