Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. Basically, this project was started by the Apache software foundation written in Java and Scala.
Kafka provides three main functions to its users :
* Publish and subscribe to streams of records.
* Effectively store streams of records in the order in which records were generated.
* Process streams of records in real time.
Kafka is primarily used to build real-time streaming data pipelines and applications that adapt to the data streams. It combines messaging, storage, and stream processing to allow storage and analysis of both historical and real-time data.
