In this post, we will look at the step-by-step process for Kafka Installation on Windows. Kafka is an open-source stream-processing software platform and comes under the Apache software foundation.
What is Kafka?
Kafka is used for real-time streams of data, to collect big data, or to do real-time analysis (or both). Kafka is used with in-memory microservices to provide durability and it can be used to feed events to complex event streaming systems and IoT/IFTTT-style automation systems.
Installation :
- Mac OS X - Download and Setup Kafka in PATH. Mac OS X - Using brew. Mac OS X - Start Zookeeper and Kafka. Mac OS X - Summary. Linux - Download and Setup Kafka in PATH. Linux - Start Zookeeper and Kafka. Linux - Summary. Windows - Download Kafka and PATH Setup. Windows - Start Zookeeper.
- Trusted Mac download Kafka Tool 1.0.2. Virus-free and 100% clean download. Get Kafka Tool alternative downloads.
- Download Conduktor 2.6.2. Always.free. for single broker clusters / 14 days free trial for production clusters OS X. Apache, Apache Kafka, Kafka.
Download the latest Apache Kafka from under Binary downloads. Click on any of the binary downloads, or choose a specific scala version if you have any.
1. Java Setup:
Kafka requires Java 8 for running. And hence, this is the first step that we should do to install Kafka. To install Java, there are a couple of options. We can go for the Oracle JDK version 8 from the Official Oracle Website.
2. Kafka & Zookeeper Configuration:
Step 1: Download Apache Kafka from its Official Site.
Step 2: Extract tgz via cmd or from the available tool to a location of your choice:
Step 3: Copy the path of the Kafka folder. Now go to config inside Kafka folder and open zookeeper.properties file. Copy the path against the field dataDir and add /zookeeper-data to the path.
Step 4: we have to modify the config/server.properties file. Below is the change:
Basically, we are pointing the log.dirs to the new folder /data/kafka.
![Kafka download for windows Kafka download for windows](/uploads/1/2/6/5/126547865/430913026.jpg)
Run Kafka Server:
Kafka Download Linux
Step 1: Kafka requires Zookeeper to run. Basically, Kafka uses Zookeeper to manage the entire cluster and various brokers. Therefore, a running instance of Zookeeper is a prerequisite to Kafka.
To start Zookeeper, we can open a PowerShell prompt and execute the below command:
If the command is successful, Zookeeper will start on port 2181.
Step 2: Now open another command prompt and change the directory to the kafka folder. Run kafka server using the command:
Now your Kafka Server is up and running, you can create topics to store messages. Also, we can produce or consume data directly from the command prompt.
Create a Kafka Topic:
- Open a new command prompt in the location C:kafkabinwindows.
- Run the following command:
Creating Kafka Producer:
- Open a new command prompt in the location C:kafkabinwindows
- Run the following command:
Kafka Download For Windows
Creating Kafka Consumer:
- Open a new command prompt in the location C:kafkabinwindows.
- Run the following command:
If you see these messages on consumer console,Congratulations!!! you all done. Then you can play with producer and consumer terminal bypassing some Kafka messages.