Applies to: 
Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace
...
You can create a dataset for use with Kyvos. When you create a dataset, choose the connection from which the data needs to be fetched. As you apply settings to sort and filter the columns, you can preview the results to make sure you get the results you are seeking.
...
From Kyvos 2024.11 onwards, when you modify any column after selecting the input type, it is you can now view a column marked as "Modified." " when changes are made to it in a dataset. Additionally, you can view the details of the changes madethose changes. This feature helps users quickly identify modified columns and review their specifics.
You can mark a file as a Fact to use it as a fact table in relationships. And you can hide columns not required for analysis.
Use the Actions menu (...) to validate the dataset, share it, add a note, or show related entities.
If your instance of Kyvos has been configured via the portal.properties file to support it, you can register a file with a Presto connection. You can format columns and preview the result.
To register a file with a Presto connection, see Creating a file with a Presto connection. You can also create register files by Writing SQL queries using data in Hive.
To learn more about the effects of some of the settings you can use while registering the file, see Logic for creating relationships and semantic model.
To create a file, perform the following steps.
From the Toolbox, click Datasets.
Click the Actions menu ( ⋮ ) and click Add Dataset.
Select the Connection from the list.
Select any one of the following input types:
| Aura tab collection |
|---|
| params | JTdCJTIyZ2VuZXJhbCUyMiUzQSU3QiUyMnRhYlNwYWNpbmclMjIlM0EwJTJDJTIydGFiV2lkdGglMjIlM0ExMDAlMkMlMjJ0YWJIZWlnaHQlMjIlM0E1MCUyQyUyMmRpcmVjdGlvbiUyMiUzQSUyMmhvcml6b250YWwlMjIlN0QlMkMlMjJjb250ZW50JTIyJTNBJTdCJTIyYmFja2dyb3VuZENvbG9yJTIyJTNBJTdCJTIyY29sb3IlMjIlM0ElMjIlMjNmZmYlMjIlN0QlMkMlMjJib3JkZXIlMjIlM0ElN0IlMjJzdHlsZSUyMiUzQSUyMnNvbGlkJTIyJTJDJTIyd2lkdGglMjIlM0ExJTJDJTIydG9wJTIyJTNBdHJ1ZSUyQyUyMmJvdHRvbSUyMiUzQXRydWUlMkMlMjJsZWZ0JTIyJTNBdHJ1ZSUyQyUyMnJpZ2h0JTIyJTNBdHJ1ZSUyQyUyMmNvbG9yJTIyJTNBJTdCJTIybGlnaHQlMjIlM0ElMjIlMjNjY2NlY2YlMjIlN0QlN0QlMkMlMjJwYWRkaW5nJTIyJTNBJTdCJTIydG9wJTIyJTNBMTAlMkMlMjJyaWdodCUyMiUzQTEwJTJDJTIyYm90dG9tJTIyJTNBMTAlMkMlMjJsZWZ0JTIyJTNBMTAlN0QlN0QlMkMlMjJhY3RpdmUlMjIlM0ElN0IlMjJiYWNrZ3JvdW5kQ29sb3IlMjIlM0ElN0IlMjJjb2xvciUyMiUzQSU3QiUyMmxpZ2h0JTIyJTNBJTIyJTIzZjU4MjI3JTIyJTdEJTdEJTJDJTIydGV4dCUyMiUzQSU3QiUyMmZvbnRTaXplJTIyJTNBMTYlMkMlMjJjb2xvciUyMiUzQSU3QiUyMmxpZ2h0JTIyJTNBJTIyJTIzMDAwMDAwJTIyJTdEJTJDJTIydGV4dEFsaWduJTIyJTNBJTIybGVmdCUyMiUyQyUyMmZvbnRXZWlnaHQlMjIlM0ElMjJib2xkJTIyJTdEJTdEJTJDJTIyaG92ZXIlMjIlM0ElN0IlMjJiYWNrZ3JvdW5kQ29sb3IlMjIlM0ElN0IlMjJjb2xvciUyMiUzQSUyMiUyM2RmZTFlNiUyMiU3RCUyQyUyMnRleHQlMjIlM0ElN0IlMjJmb250U2l6ZSUyMiUzQTE4JTJDJTIyY29sb3IlMjIlM0ElMjIlMjM1ZTZjODQlMjIlMkMlMjJ0ZXh0QWxpZ24lMjIlM0ElMjJsZWZ0JTIyJTJDJTIyZm9udFdlaWdodCUyMiUzQSUyMmxpZ2h0ZXIlMjIlN0QlN0QlMkMlMjJpbmFjdGl2ZSUyMiUzQSU3QiUyMmJhY2tncm91bmRDb2xvciUyMiUzQSU3QiUyMmNvbG9yJTIyJTNBJTIyJTIzZjRmNWY3JTIyJTdEJTJDJTIydGV4dCUyMiUzQSU3QiUyMmZvbnRTaXplJTIyJTNBMTYlMkMlMjJjb2xvciUyMiUzQSUyMiUyMzVlNmM4NCUyMiUyQyUyMnRleHRBbGlnbiUyMiUzQSUyMmxlZnQlMjIlMkMlMjJmb250V2VpZ2h0JTIyJTNBJTIybGlnaHRlciUyMiU3RCU3RCU3RA== |
|---|
|
| Aura tab |
|---|
| summary | HDFS |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJIREZTJTIyJTdE |
|---|
|
From the Toolbox, click Files. Click the Actions menu ( ⋮ ), choose Add File. Select the Connection from the list. Select the Input Type: HDFS. Select the file. Click the ... to navigate to the file. Specify the File Type such as Character Separated Values, Parquet, or Sequence.  Click the File Properties link to specify properties. Provide the line separator, field separator, escape characters, enclosed by, skip top lines, and encoding type options according to your file type.
See the Registered file settings table section for details. For Compression, select None or LZO. If the data includes header information, select Contains Header Row so that the column headings will not be included as part of the data. Select Ignore Empty Rows to have empty rows ignored. Select Key as Column to set the field name to be the column description or select Filename as column to set the file name to the column description.
Click Apply.
 To use this file for lookup purposes, select the Lookup file checkbox. See Using lookup to learn more. Click Refresh to view the columns on the right. Specify whether the file is a Dimension or Fact. If the source data contains primary key or foreign key, the system automatically marks it.  When you choose to view the Column List, you can sort, filter, and set Column Properties as needed. See the rest of this topic to learn more. Choose Preview Table to see sample data and set up a filter. See the rest of this topic to learn more. Click Save when you are finished. You can click Revert if needed.
| Aura tab |
|---|
| summary | Table |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJUYWJsZSUyMiU3RA== |
|---|
|
From the Toolbox, click Files. Click the Actions menu ( ⋮ ), choose Add File. Select the Connection from the list. Select the Input type: Table. Select the Table database followed by a table.
Or, enter a term into the Search box to quickly navigate to the file. To use this file for lookup purposes, select the Lookup file checkbox. See Using lookup to learn more. Click Refresh to view the columns. Specify whether the file is a Dimension or Fact. If the source data contains primary key or foreign key, the system automatically marks it. When you choose to view the Column List, you can sort, filter, and set Column Properties as needed. See the rest of this topic to learn more. Choose Preview Table to see sample data and set up a filter. See the rest of this topic to learn more. Click Save when you are finished. You can click Revert if needed.
 For Azure SQL DB ConnectionIf you are working with Azure SQL database connection, select an appropriate column to define the Spark partitions. A partition column enables distributed data reading during the cube build based on a range of values of the selected column. The column data type should be either number or date. For example, choose the column which is used as distribution key and sort key. Choosing an appropriate partition column greatly impacts the cube build time.
If you don't choose a partition column, Kyvos automatically chooses the first number column and uses it to define how Spark partitioning should be performed. | Panel |
|---|
| panelIconId | atlassian-note |
|---|
| panelIcon | :note: |
|---|
| bgColor | #DEEBFF |
|---|
| Note In Azure SQL Database, make sure that the fact tables with high data volume should have partitioning on the table column which is used in the Partition column option of the Kyvos register file. |
 | Aura tab |
|---|
| summary | HCatalog |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJIQ2F0YWxvZyUyMiU3RA== |
|---|
|
From the Toolbox, click Files. Click the Actions menu ( ⋮ ), choose Add File. Select the Connection from the list. Set Input Type to Table. Select the HCatalog database followed by a table.
Or, enter a term into the Search box to quickly navigate to the file. To use this file for lookup purposes, select the Lookup file checkbox. See Using lookup to learn more. Click Refresh to view the columns. Specify whether the file is a Dimension or Fact. If the source data contains primary key or foreign key, the system automatically marks it. When you choose to view the Column List, you can sort, filter, and set Column Properties as needed. See the rest of this topic to learn more. Choose Preview Table to see sample data and set up a filter. See the rest of this topic to learn more. Click Save when you are finished. You can click Revert if needed.
|
...
