Cloudera Enterprise 6.0.x | Other versions

Managing Spark Using Cloudera Manager

You can install, add, and start Spark through the Cloudera Manager Installation wizard using parcels. For more information, see Cloudera Installation Guide.

If you do not add the Spark service using the Installation wizard, you can use the Add Service wizard to create the service. The wizard automatically configures dependent services and the Spark service. For instructions, see Adding a Service.

For information on Spark applications, see Spark Application Overview.

How Spark Configurations are Propagated to Spark Clients

Because the Spark service does not have worker roles, another mechanism is needed to enable the propagation of client configurations to the other hosts in your cluster. In Cloudera Manager gateway roles fulfill this function. Whether you add a Spark service at installation time or at a later time, ensure that you assign the gateway roles to hosts in the cluster. If you do not have gateway roles, client configurations are not deployed.

Page generated July 25, 2018.