1

我目前docker-compose在一个 8 核实例（docker_serivce、dramatiq_service、rabbitmq_service、postgres_service 等）上运行： django_apscheduler==0.5.2 dramatiq [rabbitmq, watch]==1.8.1 RabbitMQ (rabbitmq: 3.8-management-alpine image)

错误是许多进程正在执行相同的任务。任务只创建一次（apscheduler BackgroundScheduler），但有几个进程尝试执行它，并且不同进程之间的一些线程是相同的。

这是一个例子。该作业在队列中一次，但是当它执行时，许多进程都会接受它。139698903181056是线程，21是进程

"INFO | 10/06/2021 10:30:09 | 139698903181056 | app.orders.tasks | tasks | tasks.py | 22 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:09 | 139698894788352 | app.orders.tasks | tasks | tasks.py | 22 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:08 | 139698911573760 | app.orders.tasks | tasks | tasks.py | 18 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:07 | 139699123865344 | app.orders.tasks | tasks | tasks.py | 19 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:03 | 139698903181056 | app.orders.tasks | tasks | tasks.py | 21 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:02 | 139698374702848 | app.orders.tasks | tasks | tasks.py | 16 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:01 | 139698903181056 | app.orders.tasks | tasks | tasks.py | 19 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:01 | 139698903181056 | app.orders.tasks | tasks | tasks.py | 21 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:01 | 139698307593984 | app.orders.tasks | tasks | tasks.py | 21 | 39 | send_menu | Sending menu #87..."
"INFO | 10/06/2021 10:30:00 | 139698861217536 | app.orders.tasks | tasks | tasks.py | 22 | 39 | send_menu | Sending menu #87..."
4

1 回答 1

0

The problem was related to Django-apscheduler.

The dramatiq container (8 workers) started with the scheduler paused, but in one part of my code, there was a piece of code that resumes the scheduler, so all 8 workers started triggering the tasks at the same time, causing the repeated tasks even though the job was created only once.

Moral: always check if your scheduler starts only once.

于 2021-06-17T20:05:14.180 回答