Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Applies to: (tick) Kyvos Enterprise  (tick) Kyvos Cloud (SaaS on AWS) (tick) Kyvos AWS Marketplace

...

For example, you have a registered dataset created using an HCatalog table with four partitions and a transformation. Then, you create a semantic model. When you process the semantic model, the full process and any subsequent incremental processes will check all directories and partitions.

...

  1. From the Toolbox, click Datasets.

  2. Click the Actions menu ( ⋮ ) then choose Add Dataset.

  3. Choose the file source type: HDFS, Table, or SQL. See Creating a dataset for details on configuring the other options.

  4. Select Lookup file to indicate that this file will be used for lookup purposes. 

  5. Click Save when you are finished. You can click Revert if needed.

Transformation

You can also specify lookup when creating a transformation. You can optionally materialize the transformation at the same time. In subsequent processes, the dataset is processed incrementally, but the output data is fully used by the semantic model or parent transformation.

To create a lookup transformation, perform the following steps: 

  1. If needed, from the Toolbox, click Utilities and select Transform Data.
    Kyvos Datasets displays in a new tab in the browser.

  2. Choose a dataset.

  3. Right-click Output and choose Properties, or double-click the Output action.

  4. Select the Save as lookup dataset checkbox. (Scroll down if needed to see it.)

  5. To preview the results, click Preview.

  6. Click Save.

...

Related topics