1

我正在尝试按照官方文档在 Ubuntu 18 上守护 Celery 4.3.0 。这是为了让 Django 项目卸载密集型任务。

当服务器运行时 celery.service 应该让 Celery worker 可用于处理任务。然而，Apache2 甚至不会运行。如果我tail看到 Apache 日志：

[Sun Sep 29 07:42:07.621273 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[Sun Sep 29 07:42:07.621279 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
[Sun Sep 29 07:42:07.621285 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
[Sun Sep 29 07:42:07.621291 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
[Sun Sep 29 07:42:07.621297 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
[Sun Sep 29 07:42:07.621303 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "/var/www/html/examgap/examgap/__init__.py", line 5, in <module>
[Sun Sep 29 07:42:07.621307 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]     from .celery import app as celery_app
[Sun Sep 29 07:42:07.621313 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "/var/www/html/examgap/examgap/celery.py", line 5, in <module>
[Sun Sep 29 07:42:07.621317 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]     from celery import Celery
[Sun Sep 29 07:42:07.621333 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952] ModuleNotFoundError: No module named 'celery'

Celery 绝对是为 Python3 安装的。我可以使用celery -A examgap worker -l warning--just 不作为守护进程为我的应用程序独立运行 Celery 工作程序。

如果我启动 Python3 shell，我也可以导入 celery。

我已经查看了几个像这样的现有 SO 问题，并认为我已经消除了一些可能性。例如，守护程序用户是 ubuntu，它对我的​​项目文件夹具有 rwx 权限。

我仍然认为问题出在我的 celery.service 文件和启动守护程序的命令上，要么没有访问正确的文件夹，要么没有使用正确的权限。

这是我的/etc/systemd/system/celery.service：

[Unit]
Description=Celery Service
After=network.target

[Service]
Type=forking
User=ubuntu
Group=ubuntu
EnvironmentFile=/etc/conf.d/celery
WorkingDirectory=/opt/celery
ExecStart=/bin/sh -c '${CELERY_BIN} multi start ${CELERYD_NODES} -A ${CELERY_APP} --pidfile=${CELERYD_PID_FILE} --logfile=${CELERYD_LOG_FILE} --loglevel=${CELERYD_LOG_LEVEL} ${CELERYD_OPTS}'
ExecStop=/bin/sh -c '${CELERY_BIN} multi stopwait ${CELERYD_NODES} --pidfile=${CELERYD_PID_FILE}' ExecReload=/bin/sh -c '${CELERY_BIN} multi restart ${CELERYD_NODES} -A ${CELERY_APP} --pidfile=${CELERYD_PID_FILE} --logfile=${CELERYD_LOG_FILE} --loglevel=${CELERYD_LOG_LEVEL} ${CELERYD_OPTS}'

[Install]
WantedBy=multi-user.target

提前致谢。

编辑：这也是我的/etc/conf.d/celery：

# Name of nodes to start
# here we have a single node
CELERYD_NODES="eg1"
# or we could have three nodes:
#CELERYD_NODES="w1 w2 w3"

# Absolute or relative path to the 'celery' command:
#CELERY_BIN="/usr/local/bin/celery"
#CELERY_BIN="/virtualenvs/def/bin/celery"
#Think I installed Celery only for user ubuntu
CELERY_BIN="/home/ubuntu/.local/bin/celery"

#CELERYD_CHDIR="/var/www/html/examgap/"
# App instance to use
# comment out this line if you don't use an app
CELERY_APP="examgap"
# or fully qualified:
# CELERY_APP="examgap.tasks:app"

# How to call manage.py
CELERYD_MULTI="multi"

# Extra command-line arguments to the worker
CELERYD_OPTS="--time-limit=300 --concurrency=8"

# - %n will be replaced with the first part of the nodename.
# - %I will be replaced with the current child process index
#   and is important when using the prefork pool to avoid race conditions.
CELERYD_PID_FILE="/var/run/celery/%n.pid"
CELERYD_LOG_FILE="/var/log/celery/%n%I.log"
CELERYD_LOG_LEVEL="INFO"

编辑 2：将 WorkingDirectory 更改为我的项目目录，现在 celery 服务正在运行。然而ModuleNotFoundError: No module named 'celery'仍然存在。

4

2 回答 2

0 
[Sun Sep 29 07:42:07.621313 2019] [wsgi:error] [pid 2648:tid 140134825535232] [remote 92.4.204.209:55952]   File "/var/www/html/examgap/examgap/celery.py", line 5, in <module>

好像你有自己的celery.py，如果是这样，你应该重命名它以避免导入问题

于 2019-10-01T07:39:38.023 回答
0

在这里，我让一些看起来很棒的链接。刚才我也在做同样的事情。

  1. https://realpython.com/asynchronous-tasks-with-django-and-celery/ （推荐）
  2. http://blog.fixter.org/hospedando-django-celery-rabbitmq-en-aws-parte-1/ （我认为这很棘手）
  3. https://dev.to/idrisrampurawala/deploying-django-with-celery-and-redis-on-ubuntu-3fo6（专业级）

我希望这对你有用。

于 2020-05-27T20:45:23.267 回答