Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • True: Kyvos will skip the invalid data rows while reading data during the build process process. The build process will fail only if the number of skipped records exceeds the threshold defined in the Semantic Model: kyvos.records.skipbadrows.threshold property. In this case, the processed row count as shown in the build process summary may be lesser than the total number of rows in the source data.

  • False: Kyvos will not skip any invalid row and immediately fail the build process as soon as an invalid record is encountered.

...

  • Connection: If the property is set at the connection, then the property value is applicable for all dataset buildprocess, semantic model buildprocess, or data profile jobs.

  • Semantic model: If the property is set on a semantic model, then the value will override the connection level value for that semantic model’s process job.

NOTE: If the property is set on a dataset and a dataset is builtprocessed, then the value will override the connection level value for that dataset process job.

Comes into effect:
The value of the property can be changed at any time (not recommended) and comes into effect in the next buildprocess.

Dependencies and Related Properties:

...

Recommendation:
If data is likely to have invalid rows that can be skipped, then set this property to true with an appropriate threshold. We do not recommend changing the value of this property in between buildsprocesses, as a change may result in inconsistent aggregated values.