Build your real-time bridge to the cloud with Confluent Platform 7.0 and Cluster Linking | Read the blog Contact Us GET STARTED FREE What is Apache Kafka®? Apache Kafka is a community distributed event streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged event streaming platform. Founded by the original developers of Apache Kafka, Confluent delivers the most complete distribution of Kafka with Confluent Platform. Confluent Platform improves Kafka with additional community and commercial features designed to enhance the streaming experience of both operators and developers in production, at massive scale. DOWNLOAD CONFLUENT DOCUMENTATION Where Apache Kafka fits in Thousands of companies are built on Kafka How can Kafka help you? Publish + Subscribe At its heart lies the humble, immutable commit log, and from there you can subscribe to it, and publish data to any number of systems or real-time applications. Unlike messaging queues, Kafka is a highly scalable, fault tolerant distributed system, allowing it to be deployed for applications like managing passenger and driver matching at Uber, providing real-time analytics and predictive maintenance for British Gas' smart home, and performing numerous real-time services across all of LinkedIn. This unique performance makes it perfect to scale from one app to company-wide use. Store An abstraction of a distributed commit log commonly found in distributed databases, Apache Kafka provides durable storage. Kafka can act as a 'source of truth', being able to distribute data across multiple nodes for a highly available deployment within a single data center or across multiple availability zones. Process An event streaming platform would not be complete without the ability to manipulate that data as it arrives. The Streams API within Apache Kafka is a powerful, lightweight library that allows for on-the-fly processing, letting you aggregate, create windowing parameters, perform joins of data within a stream, and more. Perhaps best of all, it is built as a Java application on top of Kafka, keeping your workflow intact with no extra clusters to maintain. Kafka: The Definitive Guide Learn how to take full advantage of Apache Kafka, the distributed, publish-subscribe queue for handling real-time data feeds. With this comprehensive book, you'll understand how Kafka works and how it's designed. GET YOUR COPY A toolset for streaming Apache Kafka is a popular tool for developers because it is easy to pick up and provides a powerful event streaming platform complete with 4 APIs: Producer, Consumer, Streams, and Connect. Often, developers will begin with a single use case. This could be using Apache Kafka as a message buffer to protect a legacy database that can’t keep up with today’s workloads, or using the Connect API to keep said database in sync with an accompanying search indexing engine, to process data as it arrives with the Streams API to surface aggregations right back to your application. In short, Apache Kafka and its APIs make building data-driven apps and managing complex back-end systems simple. Kafka gives you peace of mind knowing your data is always fault-tolerant, replayable, and real-time. Helping you quickly build by providing a single event streaming platform to process, store, and connect your apps and systems with real-time data. DOWNLOAD CONFLUENT LEARN MORE Product Confluent Platform Connectors ksqlDB Stream Governance Confluent Hub Subscription Professional Services Training Customers Cloud Confluent Cloud Support Sign Up Log In Cloud FAQ Solutions Financial Services Insurance Retail and eCommerce Automotive Government Gaming Technology Manufacturing Fraud Detection Customer 360 Messaging Modernization Streaming ETL Event-driven Microservices Mainframe Offload SIEM Optimization Bridge to Cloud Internet of Things Data Warehouse Developers Confluent Developer What is Kafka? Resources Events Online Talks Meetups Kafka Summit Kafka Tutorials Docs Blog About Investor Relations Company Careers Partners News Contact Trust and Security Terms & Conditions | Privacy Policy | Do Not Sell My Information | Modern Slavery Policy | Cookie Settings Copyright © Confluent, Inc. 2014-2021. Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation By clicking “Accept All Cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. Cookie Notice Cookies Settings Reject All Accept All Cookies