0

我正在使用 Apple M1 Pro Mac 并尝试使用 Docker 容器在本地开发 AWS Glue 作业,而不使用 AWS 控制台。我一直在阅读AWS的这篇博客文章,我已经从 DockerHub 中提取了amazon/aws-glue-libs: glue_libs_3.0.0_image_01 并运行命令docker run -itd -p 8888:8888 -p 4040:4040 -v ~/.aws:/root/.aws:ro --name glue_jupyter amazon/aws-glue-libs:glue_libs_3.0.0_image_01 /home/jupyter/jupyter_start.sh。Docker 容器运行但发出警告WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested,没有输出日志,并且 http://localhost:8888 不起作用。如果我运行该命令docker exec -it glue_jupyter bash,它将挂起大约 20 分钟并最终给出以下错误并以代码 127 退出:

Traceback (most recent call last):

  File "/home/glue_user/.certs/ssl_tls_setup.py", line 87, in <module>

    automated_main(keystore_path=args.keystore, keystore_pw=args.keystorepw)

  File "/home/glue_user/.certs/ssl_tls_setup.py", line 78, in automated_main

    generate_self_signed_ssl_cert(get_default_keystore_path(), keystore_pw, DEFAULT_KEY_ALIAS)

  File "/home/glue_user/.certs/ssl_tls_setup.py", line 47, in get_default_keystore_path

    instance_dns = get_instance_dns()

  File "/home/glue_user/.certs/ssl_tls_setup.py", line 15, in get_instance_dns

    private_dns = instance_metadata['local-hostname']

  File "/usr/local/lib/python3.7/site-packages/boto/utils.py", line 275, in __getitem__

    return super(LazyLoadMetadata, self).__getitem__(key)

KeyError: 'local-hostname'

Error opening input file -nokeys

-nokeys: No such file or directory

Error opening input file -nokeys

-nokeys: No such file or directory

Error opening input file -nocerts

-nocerts: No such file or directory

starting org.apache.spark.deploy.history.HistoryServer, logging to /home/glue_user/spark/logs/spark-glue_user-org.apache.spark.deploy.history.HistoryServer-1-e08471474826.out

/usr/bin/bash: /home/jupyter/jupyter_start.sh: No such file or directory
4

0 回答 0