3

我在解析 DAG 时遇到错误:

Broken DAG: [/usr/local/airflow/dags/test.py] No module named 'airflow.providers'

我将 apache-airflow-providers-databricks 添加到 requirements.txt,并从日志中看到:

Successfully installed apache-airflow-2.0.1 apache-airflow-providers-databricks-1.0.1 apache-airflow-providers-ftp-1.0.1 apache-airflow-providers-http-1.1.1 apache-airflow-providers-imap-1.0.1 apache-airflow-providers-sqlite-1.0.2 apispec-3.3.2 attrs-20.3.0 cattrs-1.3.0 clickclick-20.10.2 commonmark-0.9.1 connexion-2.7.0 flask-appbuilder-3.1.1 flask-caching-1.10.0 gunicorn-19.10.0 importlib-resources-1.5.0 inflection-0.5.1 isodate-0.6.0 marshmallow-3.10.0 marshmallow-oneofschema-2.1.0 openapi-schema-validator-0.1.4 openapi-spec-validator-0.3.0 pendulum-2.1.2 python-daemon-2.3.0 rich-9.2.0 sqlalchemy-jsonfield-1.0.0 swagger-ui-bundle-0.0.8 tenacity-6.2.0 termcolor-1.1.0 werkzeug-1.0.1

但是调度程序似乎卡住了:

The scheduler does not appear to be running. Last heartbeat was received 19 hours ago.

我怎样才能重新启动它?

4

1 回答 1

0

去掉需求中的所有dep后,mwaa中的worker可以正常运行,现在可以尝试测试坏的deps

于 2021-03-16T13:00:35.383 回答