1

我正在用 celeryd 和 RabbitMQ 撞墙。

教程中的这个例子工作得很好:

from celery import Celery

app = Celery('tasks', backend='amqp', broker='amqp://')

@app.task
def add(x, y):
return x + y

我跑:

celery -A tasks worker --loglevel=info

我得到输出:

[2014-11-18 19:47:58,874: INFO/MainProcess] Connected to amqp://guest:**@127.0.0.1:5672//
[2014-11-18 19:47:58,881: INFO/MainProcess] mingle: searching for neighbors
[2014-11-18 19:47:59,889: INFO/MainProcess] mingle: all alone
[2014-11-18 19:47:59,896: WARNING/MainProcess] celery@vagrant-ubuntu-trusty-64 ready.

我现在可以从 python repl 运行任务并获得结果。

但是当我安装 celeryd 时,该过程在混合步骤中挂起:

[2014-11-18 20:18:33,893: INFO/MainProcess] mingle: searching for neighbors

出现此之后没有输出。

我的 /etc/default/celeryd 看起来像这样:

ENABLED="true"
CELERYD_NODES="w1"
CELERYD_CHDIR="/home/myusername/src/celery-test"
CELERYD_OPTS="--time-limit=300 --concurrency=8"
CELERY_CONFIG_MODULE="celeryconfig"
CELERYD_LOG_FILE="/var/log/celery/%n.log"
CELERYD_USER="celery"
CELERYD_GROUP="celery"

我正在使用这些版本:

Ubuntu 14.04 芹菜 3.1.16 (Cipater) 芹菜 3.1.6-1ubuntu1 rabbitmq-server 3.2.4-1 Python 2.7.6

因此,如果没有守护进程,芹菜可以自行初始化,但使用守护进程(celeryd)显然会挂在混合步骤上。

一些论坛建议这是 RabbitMQ 达到磁盘空间限制的问题。我有很多磁盘,而且 RabbitMQ 自己的日志没有显示任何问题。

4

3 回答 3

2

如果您使用数据库后端,向 celery 添加以下选项应该可以解决问题:

    --without-mingle
于 2016-04-25T05:52:06.517 回答
1

I got a hunch from this message:

[2014-11-18 16:20:17,216: WARNING/MainProcess] /usr/local/lib/python2.7/dist-packages/kombu/transport/librabbitmq.py:163: UserWarning:
    librabbitmq version too old to detect RabbitMQ version information
    so make sure you are using librabbitmq 1.5 when using rabbitmq > 3.3

  warnings.warn(UserWarning(W_VERSION))

So for some reason I had librabbitmq1 apt package and it was too old.

And it turns out that problem was librabbitmq1 package. I removed it with:

sudo apt-get remove librabbitmq1

And the python Celery/RabbitMQ libs did some kind of fallback to some other (maybe plain-python?) implementation which works!

于 2014-11-19T07:25:48.257 回答
-1

Check your free disk space. RabbitMQ requires 1Gb of free space by default.

于 2016-05-24T07:21:42.317 回答