Versions Compared

Old Version 5

changes.mady.by.user Sarabjeet Kaur

Saved on

compared with

New Version Current

changes.mady.by.user NIDHI BHANDARI

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Kyvos 2023.5 has introduced Kyvos now comes with an in-house data storage layer called the Kyvos Analytical Store. The data store is designed to support complex, long-running queries that process significant portions of the stored dataset. 

This layer provides efficient data storage and retrieval capabilities that help to optimize both cost and time savings. The Kyvos Analytical Store is specifically designed to support complex, long-running queries that process substantial portions of the stored dataset. It is equipped with a columnar-vectorized query execution engine that processes a large batch of values, referred to as a "vector", in a single operation. This vectorized query execution significantly improves performance, especially in OLAP queries.

...

  1. Open the Kyvos Java options page in Kyvos Manager and Navigate to the Query Engine section. 

  2. If Configure Heap memory for Query Engine is set as Auto, no change is required. 

  3. If Configure Heap memory for Query Engine is set as Manual, reduce Off-Heap memory by 10 GB. 
    For Example, Suppose the total machine memory is 128 GB, whereas 45 GB is assigned to Heap, and 66 GB is assigned to Off-Heap. In that case, you need to set Heap as 45 GB and Off-Heap as 56 GB so Kyvos can use the remaining 10 GB internally for the new data store-based architecture. 

Panel
panelIconIdatlassian-info
panelIcon:info:
bgColor#FFFAE6

Important
In case of upgrading, you need to add the datastore jar to the Spark class path. To do this, follow the steps below.  

  1. Login to Kyvos and go to the Connection page.

  2. Search “kyvos.connection.classpath.common.jar” and add the ../lib/duckdb_jdbc.jar value in the existing class path. 

  3. Restart Kyvos services.