Document toolboxDocument toolbox

Supported Azure Configurations on Kyvos 2024.3.x

Azure

The following Azure configurations are supported for Kyvos 2024.3.x release:

Platform 

Provider version 

Deployment mode 

File source 

Execution engine 

Security 

Platform 

Provider version 

Deployment mode 

File source 

Execution engine 

Security 

Databricks 

10.4 LTS

Non-YARN 

ABFS

Spark 3.4

  • ABFS: OAuth

  • Databricks: Personal Access Token and Managed Identity

Databricks 

14.3 LTS

Non-YARN 

ABFS

Spark 3.5

  • ABFS: OAuth

  • Databricks: Personal Access Token and Managed Identity

To use Databricks 10.4 LTS, you must update the following properties in Databricks Advance Properties.

Property

Value

Property

Value

spark.sql.caseSensitive

false

spark.hadoop.spark.sql.caseSensitive

false

To use Databricks 14.3 LTS, you must update the following properties in Databricks Advance Properties.

Databricks 14.3 LTS is certified for Kyvos Enterprise.

Property

Value

Property

Value

spark.sql.caseSensitive

false

spark.hadoop.spark.sql.caseSensitive

false

spark.sql.parquet.inferTimestampNTZ.enabled false

false

spark.hadoop.spark.sql.parquet.inferTimestampNTZ.enabled false

false

spark.sql.legacy.parquet.nanosAsLong false

false

spark.hadoop.spark.sql.legacy.parquet.nanosAsLong false

false

Supported Databricks instance types

  • Worker type: E16dsv4 

    1. Min Worker: 2

    2. Max Workers: 10

  • Driver Type: E8dsv4 

Important

  • From Kyvos 2024.3.x onwards,

    • Databricks version 14.3 LTS is supported for Kyvos Enterprise.  

    • The Flexible Server version is upgraded to 16 for both new deployments and upgrades.

    • The azcopy version is upgraded from 10.16 to 10.25.

  • From Kyvos 2024.2 onwards, for Azure, Kyvos will only support Generation 2 VMs for fresh deployments.

  • From Kyvos 2023.5 onwards, Databricks SQL warehouse for ROLAP queries is supported.

  • From Kyvos 2023.5, Flexible Server version 13 is supported for both new deployments and upgrades.

  • Cuboid replication type - Local and ABFS (ADLS Gen2) are supported. Recommended replication type is Local. 

  • Kyvos supports Standard_D8s_v4 series VM type for BI Server and Standard_E8s_v4 series type for Query Engines.

 

 

Copyright Kyvos, Inc. All rights reserved.