All forum topics Previous Next 1 REPLY ManuelCalvo Expert Contributor Created 06-07-2018 03:39 PM In order to list consumers, you can use: /usr/hdp/current/kafka-broker/bin/kafka-consumer-groups.sh --zookeeper <zkHost>:<zkPort> --list Note: This will only show information a...
The first thing to understand is that a topic partition is the unit of parallelism in Kafka. On both the producer and the broker side, writes to different partitions can be done fully in parallel. So expensive operations such as compression can utilize more hardware resources. On the consumer...
In this tutorial, you’ll learn how to manage resources in a Kafka cluster using theKafkaAdminClientAPI. You’ll also learn how to retrieve information about the cluster programmatically and how to create, list, and delete topics. You’ll also learn about thekcatCLI utility, which allows you ...
The first thing to understand is that a topic partition is the unit of parallelism in Kafka. On both the producer and the broker side, writes to different partitions can be done fully in parallel. So expensive operations such as compression can utilize more hardware resources. On the consumer...
nano~/kafka/config/server.properties Copy Let’s add a setting that will allow us to delete Kafka topics. Add the following to the bottom of the file: ~/kafka/config/server.properties delete.topic.enable = true Save the file, and exitnano. Now that we’ve configured Kafka, we can move...
Run below command to list all the the topics bin/kafka-topics.sh --zookeeper localhost:2181 --list Describe Topic Run below command to describe the topic. This returns topic partition and replication information. bin/kafka-topics.sh --zookeeper localhost:2181 --describe ...
By default, Kafka doesn't allow you to delete topics. To be able to delete topics, add the following line at the end of the file: ~/kafka/config/server.properties delete.topic.enable = true 1. Save the file, and exit vi. ...
Login as the 'kafka' user and go to the 'bin/' directory. su - kafka cd bin/ Now create a new topic named 'HakaseTesting'. ./kafka-topics.sh --create --zookeeper localhost:2181 \ --replication-factor 1 --partitions 1 \ --topic HakaseTesting ...
bin/kafka-topics.sh--bootstrap-serverlocalhost:9092--list The above command will print the following: input-topic output-topic Writing the kafka streams application Create a new Java Maven project in your IDE. If you want to know more about maven you can readthis beginners guide to maven ...
day-to-day working with Kafka, we need to do proper management of the Kafka topics also. In the few version of Kafka, the deletion of the Topic is very easy. There are different ways to delete the Kafka topic like manual deletion of the Kafka topic, with the help of the zookeeper, ...