Using lookup

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace   Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

You can specify that data is a lookup file or dataset either when registering a dataset. 

Dataset

When you enable lookup in a registered dataset, the complete source data is processed. 

For example, you have a registered dataset created using an HCatalog table with four partitions and a transformation. Then, you create a semantic model. When you process the semantic model, the full process and any subsequent incremental processes will check all directories and partitions.

To create a lookup file, perform the following steps. 

1. From the Toolbox, click Datasets.

2. Click the Actions menu ( ⋮ ) then choose Add Dataset.

3. Choose the file source type: HDFS, Table, or SQL. See Creating a dataset for details on configuring the other options.

4. Select Lookup file to indicate that this file will be used for lookup purposes. 

5. Click Save when you are finished. You can click Revert if needed.

Transformation

You can also specify lookup when creating a transformation. You can optionally materialize the transformation at the same time. In subsequent processes, the dataset is processed incrementally, but the output data is fully used by the semantic model or parent transformation.

To create a lookup transformation, perform the following steps: 

1. If needed, from the Toolbox, click Utilities and select Transform Data.
   Kyvos Datasets displays in a new tab in the browser.

2. Choose a dataset.

3. Right-click Output and choose Properties, or double-click the Output action.

4. Select the Save as lookup dataset checkbox. (Scroll down if needed to see it.)

5. To preview the results, click Preview.

6. Click Save.

Related topics

• Working with datasets