Page Comparison

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

...

• From Kyvos 2024.3 onwards, for executing to execute the sanity suite for no-spark and Kubernetes (K8S) supported deployments, refer to the <> Prerequisites for no-spark deployments section.

• From Kyvos 2023.5 onwards, AWS Managed Services will no longer require Kyvos user credentials to execute the sanity suite from Kyvos Manager. Previously, after each deployment or upgrade, our support team needed Kyvos user credentials to run a sanity suite and ensure system functionality. This was challenging in managed services deployment. The latest update eliminates the need for user credentials, streamlining the verification process for successful deployment/upgrades and ensuring proper system functionality.

• Starting version 2023.1, Sanity Suite deploys a single folder rather than three to execute operations on all of the Entities that are deployed during its execution. Users should remove any folders with their names included in the below-mentioned list from previous executions before running Sanity Suite if present on the cluster. List of Folder that must be deleted if present: "Sanity_Cube_On_HCatalog, Sanity_Cube_On_HDFS, Sanity_Cube_ON_MultiFact, Sanity_DRD_ON_HCatalog, Sanity_DRD_ON_HDFS, Sanity_DRD_ON_MultiFact, Sanity_RF_ON_HCatalog, Sanity_RF_ON_HDFS, Sanity_RF_ON_MultiFact, Sanity_RF_ON_SQL"

• From Kyvos 2023.2 onwards, at the start of Sanity Suite, a 'NOW' type schedule (set as default) is set for one hour using the REST API to keep the Kyvos cluster online with full (100%) Query Engine capacity. However, you can disable the 'NOW' type schedule by modifying the 'Is Cluster Scaling Enabled' property in the sanity.properties file and setting it to false.

...

• Create database kyvosrepo_$clustername if the KYVOS_QUERY_ANALYZER_DATABASE is not present in the olapengine.properties file.

• Create database $value of KYVOS_QUERY_ANALYZER_DATABASE if KYVOS_QUERY_ANALYZER_DATABASE is present in the olapengine.properties file.

• Ensure that the Sanity_table Sanitytable table must exist when you are creating a database. 
  NOTE: If AWS Glue is enabled, the Sanity_Sanitytable tabletableis not created for AWS cluster deployment. Similarly, if Dataproc Metastore is enabled, this table is not created for GCP cluster deployment. 

Prerequisites for no-Spark deployments

...

Anchor
prereqforno-spark prereqforno-spark

Before executing sanity suite, you must perform the following steps.

• MSSQL

• Snowflake Warehouse

• Azure SQL Warehouse

For MSSQL

Anchor
MYSQL MYSQL

...

1. Create a database “SANITYSUITE”;

2. Create a schema “DBO”.

3. Create the table using the following syntax:

   Code Block

   CREATE DATABASE sanitysuite; CREATE TABLE dbo.sanity_table ( product_id INT, product_category VARCHAR(255), manufacturer VARCHAR(255), product_type VARCHAR(255), product_name VARCHAR(255), order_priority VARCHAR(255), sale_amount FLOAT, order_quantity INT, discount FLOAT, continent VARCHAR(255), country VARCHAR(255), region VARCHAR(255), state VARCHAR(255), city VARCHAR(255), profit FLOAT, customer_name VARCHAR(255), customer_segment VARCHAR(255), shipping_cost FLOAT, date_1 VARCHAR(255), quarter VARCHAR(255), month VARCHAR(255), week VARCHAR(255), day VARCHAR(255));

...

1. Insert the following data in the sanity table you have created in Step 1.

   Code Block
   BULK INSERT databaseName.tableName FROM 'pathOfCsvFile' WITH ( FIELDTERMINATOR = ',', ROWTERMINATOR = '\n' );

Step 3: To create MSSQL Warehouse connection for sanity suite, see the Working with MSSQL warehouse connection section.

...

1. In the Stages tab upload, the sanity data from the file.

2. Download the sanity data file.

3. Click the Load Data button to upload the data file.

4. From the File format list, select CSV.

5. On header, select skip first line.

6. Select Field delimiter as Vertical Bar.

7. Load the data by clicking the Load Button.

   

Step 3: To create Snowflake Warehouse connection for sanity suite, see the Working with Snowflake warehouse connection section.

Azure SQL Warehouse

Anchor
AzureSQL AzureSQL

Step 1: Create the following Database and table.

...

BULK INSERT databaseName.tableName
FROM 'pathOfCsvFile'
WITH (
FIELDTERMINATOR = ',',
ROWTERMINATOR = '\n'
);

Step 3: To create Snowflake Azure SQL Warehouse connection for sanity suite, see the Working with Azure SQL warehouse connection section.

...