1

我有一个长期运行的 Python 脚本,可以将文档从 MongoDB 上传到 GC 存储。文档首先导出到本地 csv 文件,然后将该 csv 文件上传到 GC 存储。

在出现错误之前,脚本运行了大约 10 个小时,没有出现任何问题。是什么导致了这个错误?

我使用 GCS 的代码:

client = storage.Client.from_service_account_json(KEY_JSON)

def upload_file(filepath):
    bucket = client.get_bucket(BUCKET_NAME)
    blob = bucket.blob(filepath)
    blob.upload_from_filename(filepath)

    logging.info("Uploaded file {} to GCS.", str(filepath))

堆栈跟踪:

Traceback (most recent call last):
  File "/home/leonz/.local/lib/python3.5/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/home/leonz/.local/lib/python3.5/site-packages/urllib3/connectionpool.py", line 357, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.5/http/client.py", line 1107, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python3.5/http/client.py", line 1152, in _send_request
    self.endheaders(body)
  File "/usr/lib/python3.5/http/client.py", line 1103, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python3.5/http/client.py", line 936, in _send_output
    self.send(message_body)
  File "/usr/lib/python3.5/http/client.py", line 908, in send
    self.sock.sendall(data)
  File "/usr/lib/python3.5/ssl.py", line 899, in sendall
    v = self.send(data[count:])
  File "/usr/lib/python3.5/ssl.py", line 869, in send
    return self._sslobj.write(data)
  File "/usr/lib/python3.5/ssl.py", line 594, in write
    return self._sslobj.write(data)
BrokenPipeError: [Errno 32] Broken pipe
4

0 回答 0