java - Upload 2GB file with Apache HttpClient

Question

I'm new to Apache HC and I'm wondering what is the best way to upload files of about 1 or 2 GB size.

I am using the Minio SDK to retrieve a presigned url from the server. After that, I am sending this presigned url to the client that will upload the specified file.

From Minio side, the max size per put operation is 5GiB so there should be no problems from minio side. My main concern is:

What would be the best way to achieve the upload of the file from Apache HC in order to get the best performance / less error prone behaviour?

I'm guessing that directly uploading a 2GB file is not a good option. Does the Apache HttpClient handles that upload in case an error occur? Is it convenient to upload the file as parts? How do I achieve that?

Answer 1

从 Minio 方面来看，每次 put 操作的最大大小为 5GiB，因此从 minio 方面应该没有问题。我主要担心的是：

为了获得最佳性能/不易出错的行为，从 Apache HC 上传文件的最佳方法是什么？

我猜直接上传 2GB 文件不是一个好的选择。如果发生错误，Apache HttpClient 是否会处理该上传？将文件作为部分上传是否方便？我该如何做到这一点？

Minio 服务器将每个 PutObject 的最大大小更改为 16GiB。Apache 客户端应该可以毫无问题地处理高达 2GiB 的上传。