Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

Applies to: Image Modified Kyvos Enterprise   Image Modified Kyvos Cloud (Managed Services on AWS)     Image Modified Kyvos Azure Marketplace

Image Modified Kyvos AWS Marketplace   Image Modified Kyvos Single Node Installation (Kyvos SNI)     Image Modified Kyvos Free ( Limited offering for AWS)

...

Use Replace Partition to update the data during an incremental process. For example, when there is a change in user data, Kyvos identifies that change and replaces it in semantic model data, which was already processed. This option is only available if you have time or date data available.

...

Data for old partitions may be provided with new datasets, or the same dataset may be updated. Files with an updated timestamp are only processed when Replace Partition is selected.

Warning
titleWarning

Don’t use Replace Partition with materialized transformations. When you replace partitions of materialized data, you run the risk of duplicating data because the underlying data may not have the same partitioning and replacement policy as you are specifying in the dialog box. If  you are using a materialized transformation, you will see a warning message


When the semantic model is updated, Kyvos evaluates which rows are intended for the older semantic model partitions
and considers that a partition replacement. Kyvos identifies the older semantic model partitions using the Time dimension field and checks to see if this value already exists in the semantic model. The other changed rows are considered part of the incremental build.

...

  • None doesn't replace the partition. This option works like an incremental process when new data arrives and does not replace the partition.
  • Auto identifies the partition automatically.

...

Related topics