Semantic Model: kyvos.indexing.map.distributed.mb
Description:
The property specifies the container memory for indexing jobs that are launched during full and/or incremental semantic model processing.
Values and behavior:
Any positive number represents the number of megabytes of container memory.
Default value:
Value configured in mapreduce.map.memory.mb
Scope:
Connection: If the property is applied at the connection, then the containers of Mapper jobs will be launched with the same memory for all the cubes (if not applied to the cube).
Semantic model: If the property is applied at the semantic model and connection both, then the value set at the semantic model will be respected for that particular semantic model.
Comes into effect:
The value of the property can be changed at any time and will come into effect after the next semantic model process instance.
Dependencies and related properties:
The value of the kyvos.indexing.map.distributed.opts property should be 55-65% of the memory specified in this property.
The default value takes the value specified in the mapreduce.map.memory.mb property.
Recommendation:
The property value should be configured considering the highest expected cardinality in the cube for any dimension or distinct count measure.Â
Kyvos lab tested optimal settings:Â For a dimension/distinct count measure with a cardinality of 1 Billion, the property should be set to 25600 (25 GB).
Copyright Kyvos, Inc. All rights reserved.