Refining data in datasets

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace   Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

You can filter the columns and data in a dataset to exclude the data that you don't plan to use and have it contain only the data used in builds and data profiles. This step allows you to avoid unnecessary data processing.

When possible, you should use this option to fine-tune the data instead of creating a transformation using the file. 

To filter the column data, perform the following steps. 

1. From the Toolbox, select the object type, such as Datasets.

2. Select a registered dataset.

3. Click Filter Columns to filter the columns on the basis of Data Type, Data Subtype, and Visibility.
   To remove, click Remove Filtering.

   Open

   

4. Click Filter data to filter the data.

   Open

   

5. Select a Field, Criteria, Comparison, and Value. 

6. Click the Plus button to add an additional row or Minus to remove rows.

7. You can use parenthesis and AND or OR to create more complex criteria. 

8. Click Apply. 

9. If the filters don't validate with the data, you won't be able to save the file. You need to correct the errors before you can save the file.

You can also format the column details and filter the data at the point you register the dataset. 

Related topics

• Creating a dataset

• Logic for creating relationships and semantic model