Kafka Installation (CDH)

In this post i am going to show " How to install Kafka using parcels"

  1. Download required parcel files from http://archive.cloudera.com/kafka/parcels/
  2. Starting the server
    1. Place those above downloaded parcel and repo files in /var/www/html and start "httpd" service
Check server status by opening http://hostname:80
Or
    1. You can start HTTPServer where you downloaded files by using below code
           python -m SimpleHTTPServer 8900
Check server status by opening http://hostname:8900
  1. Create local kafka repo to detect by Cloudera Manger
sudo vim /etc/yum.repos.d/cloudera-kafka.repo
[cloudera-kafka]
# Packages for Cloudera's Distribution for kafka, Version 1, on RedHat or CentOS 7 x86_64
name=Cloudera's Distribution for kafka, Version 1
baseurl=http://10.170.1.94:8800/files/kafka/
gpgkey = http://10.170.1.94:8800/files/kafka/RPM-GPG-KEY-cloudera
gpgcheck = 1
  1. After repo creation, need to clean yum repo and need to update
sudo yum clean all
sudo yum update
  1. Now login into your cloudera manager web console





Enter Kafka Broker lists (You can enter 1 node or multiple node names)





Then start Installation

Note: Update JAVA Heap size to 256 MB
Previous
Next Post »