如何设置 S3SinkConnector 将数据从我的主题流式传输到 S3 存储桶?我已经从 confluent hub 下载了插件,创建了一个文件connect-standalone.properties
和s3-sink.properties
.
当我尝试运行./connect-standalone.sh connect-standalone.properties s3-sink.properties
时,出现错误:
[2019-06-25 15:43:52,841] ERROR Failed to create job for s3-sink.properties (org.apache.kafka.connect.cli.ConnectStandalone:102)
[2019-06-25 15:43:52,842] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:113)
java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches io.confluent.connect.s3.S3SinkConnector
但我可以看到这个插件可用:
available connectors are: PluginDesc{klass=class io.confluent.connect.s3.S3SinkConnector, name='io.confluent.connect.s3.S3SinkConnector', version='5.2.2', encodedVersion=5.2.2, type=sink, typeName='sink', location='file:/home/ec2-user/kafka-plugins/confluentinc-kafka-connect-s3-5.2.2/'}
另外,我尝试使用导出 CLASSPATH export CLASSPATH=/home/ec2-user/kafka-plugins
,但仍然没有幸运。
如何使用 AWS MSK 设置 S3SinkConnector?