Spark2 installation Cloudera

Spark2 installation Cloudera

5:36 PM
  1. Download the Spark2 CSD (jar+ Parcel)
  2. Move downloaded jar to CSD location (default /opt/Cloudera/csd) in Cloudera Server node
  3. Restart the Cloudera server
sudo service cloudera-scm-server restart

  1. Log in the Cloudera Manager Admin Console, restart Cloudera Management Services
  2. Add the Spark2 parcel location to the remote repository URLs, which is downloaded in step 1
  3. Download, distribute the parcel to the hosts in your cluster, and activate the parcel
  4. Add the Spark 2 service to your cluster. When configuring the assignment of role instances to hosts, add a gateway role to every host. The History Server port is 18089 instead of the usual 18088.
  5. Return to the Home page by clicking the Cloudera Manager logo.
  6. Click to invoke the cluster restart wizard.
  7. Click Restart Stale Services.
  8. Click Restart Now.
  9. Click Finish.
Next
« Prev Post
Previous
Next Post »
Subscribe to: Post Comments (Atom)