Semantic Model: kyvos.build.blankvalue.badrow

Description:

The property specifies the behavior for considering the blank/NULL values in numeric and date-type fields used as levels or attributes in a semantic model as valid or invalid.

Values and behavior:

True: Considers blank/NULL as an invalid value in the number or date type fields and the record is skipped during data processing. When default values are provided for number and date fields, all the NULL/blank will be replaced by the given values. Otherwise, NULL values will be left as is in the record. Records with NULLs values will be skipped during data validation.
False: Considers blank/NULL as a valid value in the number or date type fields and the record will not be skipped during data processing. When default values are provided for number and date fields, all the NULL/blank will not be replaced by the given default values. Records with NULLs values will not be skipped during data validation.

Default value:

True

Scope:

Connection: If the property is set at the connection, then the property value is applicable for all transformation processes, semantic model processes, or data profile jobs launched using Spark.
Semantic model: If the property is set on a semantic model, then the value will override the connection level value for that semantic model’s job.

Dependencies and related properties:

Recommendation:
It avoids the skipping of complete record if any number or date field contains null or blank value. But the user needs to add handling for NULL value in formula fields which are created over these kinds of data fields.

NOTE: This property controls the behavior of kyvos.records.skipbadrows and treats the null value as valid when the above property is false.