允许应用程序订阅一个或者多个主题,并处理这些主题接收到的记录流。 3、StreamsAPI 代码语言:javascript 代码运行次数:0 运行 AI代码解释 允许应用程序充当流处理器(stream processor),从一个或者多个主题获取输入流,并生产一个输出流到一个或 者多个主题,能够有效的变化输入流为输出流。 4、ConnectAPI 代码语言:java...
第6 章 Kafka Connect 配置属性 config.storage.topic type:string Importance:high 存储连接器配置的 Kafka 主题的名称。 group.id type:string Importance:high 此worker 所属的连接集群组的唯一字符串。 key.converter type:class Importance:high 用于在 Kafka Connect 格式和...
base_dir=$(dirname$0)if["x$KAFKA_LOG4J_OPTS"="x"];thenexport KAFKA_LOG4J_OPTS="-Dlog4j.configuration=file:$base_dir/../config/connect-log4j.properties"fiif[ -z"$KAFKA_HEAP_OPTS"];thenexport KAFKA_JMX_OPTS="-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false ...
带有默认值connect-cluster-offsets的offset.storage.topic config.storage.topic带有默认值connect-cluster-configs status.storage.topic带有默认值connect-cluster-status key.converter带有默认值org.apache.kafka.connect.json.JsonConverter value.converter,默认值为org.apache.kafka.connect.json...
核心API Kafka 有四个核心API,它们分别是 Producer API,它允许应用程序向一个或多个 topics 上发送消息记录 Consumer API,允许应用程序订阅一个或多个 topics 并处理为其生成的记录流 Streams API,它允许应用程序作为流处理器,从一个或多个主题中消费输入流并为其生成输出流,有效的将输入流转换为输出流。
51CTO博客已为您找到关于kafka connect api的相关内容,包含IT学习相关文档代码介绍、相关教程视频课程,以及kafka connect api问答内容。更多kafka connect api相关解答可以来51CTO博客参与分享和学习,帮助广大IT技术人实现成长和进步。
如果需要了解Kafka Connect更详细的使用方法,请参见Kafka官网资料https://kafka.apache.org/documentation/?spm=a2c4g.11186623.2.28.15297af1wj9SpN#connect和REST API https://docs.confluent.io/current/connect/references/restapi.html?spm=a2c4g.11186623.2.29.15297af1DnX5y5。
If you want to call a DataStream API to read or write data, you must use a DataStream connector of the related type to connect to Realtime Compute for Apache Flink. For more information about how to configure a DataStream connector, see Settings of DataStream connectors. Create a Kafka sou...
http://connect:8083/connectors-w"\n" Note Why do I see the message 'Failed to connect'? It takes up to three minutes for the Kafka Connect REST API to start. If you receive the following error, wait three minutes and run the preceding command again: ...
For more information on how to Connect API, see https://kafka.apache.org/documentation/#connect. Prerequisites An Apache Kafka cluster on HDInsight. For more information, see Kafka on HDInsight quickstart document. An edge node in the Kafka cluster. For more information, see Use edge nodes wi...