0

如何设置 S3SinkConnector 将数据从我的主题流式传输到 S3 存储桶?我已经从 confluent hub 下载了插件,创建了一个文件connect-standalone.propertiess3-sink.properties.

当我尝试运行./connect-standalone.sh connect-standalone.properties s3-sink.properties时,出现错误:

[2019-06-25 15:43:52,841] ERROR Failed to create job for s3-sink.properties (org.apache.kafka.connect.cli.ConnectStandalone:102)
[2019-06-25 15:43:52,842] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:113)
java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.s3.S3SinkConnector

但我可以看到这个插件可用:

available connectors are: PluginDesc{klass=class io.confluent.connect.s3.S3SinkConnector, name='io.confluent.connect.s3.S3SinkConnector', version='5.2.2', encodedVersion=5.2.2, type=sink, typeName='sink', location='file:/home/ec2-user/kafka-plugins/confluentinc-kafka-connect-s3-5.2.2/'}

另外,我尝试使用导出 CLASSPATH export CLASSPATH=/home/ec2-user/kafka-plugins,但仍然没有幸运。

如何使用 AWS MSK 设置 S3SinkConnector?

4

1 回答 1

0

你不应该导出 CLASSPATH

您必须在 connect-standalone 属性中进行设置

plugin.path=/home/ec2-user/kafka-plugins
于 2019-06-26T03:12:13.173 回答