BUILD_CLUSTER_STATS_COLLECTION_FREQ

Description:

This property is used to provide time interval (in seconds), at which the YARN cluster stats will be captured. These stats are required to estimate the time and cost of subsequent data processes. 

Possible Values:

• Any positive integer: YARN cluster stats will be captured at this frequency.

• Any integer less than or equal to 0: Cluster stats capturing will be disabled.

Default value:

30

Scope:

BI Server

Comes into effect:

This is a hot deployed property. The administrator can change its value, and it will be applied instantly. No BI Server restart is required.

Impact Area:

AWS cluster with On-Demand EMR and GCP cluster

Environment:

Applicable in all environments.