Description:
This property specifies the amount of heap memory per executor when jobs are executed using Spark. Kyvos delegates this property value to the same-named property of Spark when Kyvos submits a dataset buildprocess, semantic model buildprocess, or data profile job to Spark.
...
Comes into effect:
This property comes into effect only when the underlying build process engine is set to Spark. The value of the property can be changed at any time and will be respected in the next buildprocess.
Dependencies and related properties:
...
Recommendation:
The default value of the property should work fine for most scenarios. If the semantic model build process jobs fail due to memory-related failures, then the job memory can be increased using this property. The values are recommended to be in the range of 15g to 24g.
...