我有一个 Kubeflow 管道,它调用 Dataflow 来执行作业,但我一直遇到同样的问题:
subprocess.CalledProcessError: Command '['/usr/bin/python3', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']' returned non-zero exit status 1.
就我目前所见,pip 不再支持下载选项,因此管道失败。但是,进一步调查我从 rsa==4.0.0 模块收到另一条消息,其中它有一个 UnicodeDecode 错误,应该已经根据其Github 问题修复 错误如下:
Saved /tmp/dataflow-requirements-cache/rsa-4.0.tar.gz
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-build-z1xp0h1i/rsa/setup.py", line 20, in <module>
long_description = f.read()
File "/usr/lib/python3.6/encodings/ascii.py", line 26, in decode
return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: \'ascii\' codec can\'t decode byte 0xc3 in position 898: ordinal not in range(128)
另外,这就是我所说的 Dataflow 管道。
pipeline_args.extend(
[
"--runner=DataflowRunner",
"--project={PROJECT_ID}",
"--staging_location={STAGE_BUCKET}",
"--temp_location={TEMP_BUCKET}",
f"--job_name={JOB_NAME}-{str(uuid.uuid4())[:6]}",
f"--requirements_file={REQUIREMENTS_LOCAL}",
"--region={}".format(REGION),
]
)
我在这里想念什么?