Apache kafka cookbook
Subtitle: over 50 hands-on recipes to efficiently administer, maintain, and use your Apache Kafka installation
By: Saurabh Minni
Series: Quick answers to common problems; Quick answers to common problems
Publisher: Packt Publishing Limited; Packt Publishing - ebooks Account
Published: 2015
Place of publication: Birmingham, UK
Language: eng
Number of pages: 111
ISBN-13: 9781785880186; 9781785882449
Subjects: Telecommunication; Message processing; Information storage and retrieval systems; Application software; Programming; Télécommunications; Traitement de messages; Systèmes d'information; Logiciels d'application; Programmation; Information storage; Information retrieval services; COMPUTERS; Database Management; General
Notes: Includes index.
Table of contents: title: Cover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Initiating Kafka; Introduction; Setting up multiple Kafka brokers; Creating topics; Sending some messages from the console; Consuming from the console; Chapter 2: Configuring Brokers; Introduction; Configuring the basic settings; Configuring threads and performance; Configuring the log settings; Configuring the replica settings; Configuring the ZooKeeper settings; Configuring other miscellaneous parameters; Chapter 3: Configuring a Producer and Consumer; Introduction.; title: Configuring the basic settings for producerConfiguring the thread and performance for producer; Configuring the basic settings for consumer; Configuring the thread and performance for consumer; Configuring the log settings for consumer; Configuring the ZooKeeper settings for consumer; Other configurations for consumer; Chapter 4: Managing Kafka; Introduction; Consumer offset checker; Understanding dump log segments; Exporting the ZooKeeper offsets; Importing ZooKeeper offsets; Using GetOffsetShell; Using the JMX tool; Using the Kafka migration tool; The MirrorMaker tool; Replay Log Producer.; title: Simple Consumer ShellState Change Log Merger; Updating offsets in Zookeeper; Verifying consumer rebalance; Chapter 5: Integrating Kafka with Java; Introduction; Writing a simple producer; Writing a simple consumer; Writing a high-level consumer; Writing a producer with message partitioning; Multithreaded consumers in Kafka; Chapter 6: Operating Kafka; Introduction; Adding and removing topics; Modifying topics; Implementing a graceful shutdown; Balancing leadership; Mirroring data between Kafka clusters; Expanding clusters; Increasing the replication factor; Checking the consumer position.; title: Decommissioning brokersChapter 7: Integrating Kafka with Third-Party Platforms; Introduction; Using Flume; Using Gobblin; Using Logstash; Configuring Kafka for real-time; Integrating Spark with Kafka; Integrating Storm with Kafka; Integrating Elasticsearch with Kafka; Integrating SolrCloud with Kafka; Chapter 8: Monitoring Kafka; Introduction; Monitoring server stats; Monitoring producer stats; Monitoring consumer stats; Connecting to Graphite; Monitoring with Ganglia; Index.