...
This property specifies the number of invalid rows that can be skipped with the Semantic Model: kyvos.records.skipbadrows property. Once this threshold is reached, the dataset or semantic model build process will fail.
Values and behavior:
...
Comes into effect:
This property comes into effect only when Semantic Model: kyvos.records.skipbadrows is set to TRUE. The value of the property can be changed at any time and will be respected in the next buildprocess.
Dependencies and related properties:
...
Recommendations:
The threshold is applied per MapReduce Mapper or Spark Map task. For a build process that has a threshold of 10,000 and 10 Mapper tasks, the build process will not fail until a single task encounters 10,000 invalid rows. Each of the tasks can have 9,000 invalid rows, which means 90,000 invalid rows in total; and the build process will succeed.