Kyvos Analytical Store

Kyvos has introduced an in-house data storage layer called the Kyvos Analytical Store. The data store is designed to support complex, long-running queries that process significant portions of the stored dataset. 

This layer provides efficient data storage and retrieval capabilities that help to optimize both cost and time savings. The Kyvos Analytical Store is specifically designed to support complex, long-running queries that process substantial portions of the stored dataset. It is equipped with a columnar-vectorized query execution engine that processes a large batch of values, referred to as a "vector", in a single operation. This vectorized query execution significantly improves performance, especially in OLAP queries.

Certified Providers and supported Operating Systems for Kyvos Analytical Store

The Kyvos 2024.1.1 is certified to work on the following provider and OS versions with the Kyvos Analytical Store.

Prerequisites

To use Kyvos Analytical Store, you must ensure the following:

• The value of ENABLE_KYVOS_ANALYTICAL_STORE property should be set as Enable.

• The value of ELASTIC_DEPLOYMENT should be set as Disable.

• The value of kyvos.cuboid.replication.type property should be set as Local on the semantic model.

Using Kyvos Analytical Store for semantic models

Kyvos Analytical Store is not enabled by default. To use the Kyvos Analytical store as data storage layer for a semantic model, use the the following property on the semantic model. 

Property: kyvos.build.aggregate.type  

Value: Tabular 

Scope: Semantic model advanced property 

Add Kyvos Analytical Store jar in class path 

To add Kyvos Analytical Store Jar in class path, perform the following steps.

1. Login to Kyvos and navigate to the Connections page.

2. On the Connections page, click Properties.

   

3. On the Edit Properties dialog box, search “kyvos.connection.classpath.common.jar” and enter the ../lib/duckdb_jdbc.jar value in the existing class path.

   

4. Restart Kyvos services.  

Memory tuning parameters 

From Kyvos 2023.5 onwards, Heap, Off-heap, and other required memory on Query Engines are automatically configured if memory mode is set to Auto mode.  For more details, see the Kyvos Java options page in Kyvos Manager.

To enable Kyvos Analytical store, perform the following steps.

Enhancements in Kyvos Analytical Store

Kyvos 2024.1.x

Kyvos comes with an enhanced Query Engine JVM configuration as per Kyvos Data Store Analytics configurations. To enable this feature, set the value of the ENABLE_KYVOS_ANALYTICAL_STORE property to 'Yes.' After configuring the Kyvos Data Store value, you must disable cluster scaling. Achieve this by setting the ELASTIC_DEPLOYMENT property to 'Disable.

Kyvos 2024.1

• Support for Decimal type measures: The Kyvos Analytical store efficiently stores, retrieves, and queries big decimal measures created via Kyvos. This release supports reading 128-bit decimal numbers via Parquet files with the help of a fixed-length byte array.

• Kyvos Analytical Store statistics: With this release, users can now see Kyvos Analytical Store statistics on the Activity Monitor. To view the Kyvos Analytical Store information, navigate to the Activity Monitor, then click the Query Engine. A detailed view dialog box is displayed. The information displays the total number of available Analytical Store connections and the number of connections currently being used. Users can also check the total amount of memory available and the percentage of memory used.

  

• Support for Parent-Child Hierarchy (PCH): With this release, Kyvos supports processing and browsing the semantic models having parent-child hierarchy, alternate hierarchy, and custom rollups in the Kyvos Analytical Store.

• Support for attribute level smart aggregates: This release supports attribute level smart aggregates in Kyvos Analytical Store.