Page Comparison

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

...

The Hadoop or YARN cluster is a critical resource for running Spark or MapReduce jobs to do build process activities. Running a build process cluster in a cloud environment such as AWS, Azure, or Google incurs costs. Therefore, the cluster must be 'up' only to do any processing activity. Upon completion of the process activity, the cluster must be terminated or stopped to save costs. To reduce the costs of the cloud resources and increase the scalability and performance of the cluster, Kyvos allows you to configure an on-demand Hadoop or YARN cluster by using Kyvos properties from Kyvos Manager. Configuring on-demand EMR or GCP clusters typically reduces your cloud costs. 

...

The configuration properties of the on-demand cluster are of the following types:

• BUILD_CLUSTER_INACTIVE_TIME_INTERVAL: This property is used to specify the inactive time for scheduled processes. 

• BUILD_CLUSTER_SETUP_THRESHOLD: This property is used to specify the time required for creating a job cluster. 

• BUILD_CLUSTER_SHUTDOWN_INTERVAL: This property is used to specify the time to terminate a job cluster. 

To modify the default value of the property, perform the following steps. 

1. To access the Properties page, click the cluster name > Kyvos and Ecosystem > Kyvos Properties on the navigation pane.
   The Kyvos Properties dialog is displayed.

   

2. Expand the olapengine.properties file and look for the properties to configure the on-demand cluster. 

   

3. The default value of the property is displayed next to the property name. You can also change the default value as needed.

4. In this section, you can also do the following: 

   1. Click Expand All or Collapse All link to view or hide all properties.

   2. Click the i icon corresponding to a property to view its description. Alternatively, click the Show Description button from the bottom of the page to view the properties' descriptions.

...