Supported Azure Configurations on Kyvos 2024.12

Azure

The following Azure configurations are supported for Kyvos 2024.12 release:

Platform	Provider version	Deployment mode	File source	Execution engine	Security

Platform	Provider version	Deployment mode	File source	Execution engine	Security
Databricks	10.4 LTS	Non-YARN	ABFS	Spark 3.4	ABFS: OAuth Databricks: Personal Access Token and Managed Identity
Databricks	14.3 LTS	Non-YARN	ABFS	Spark 3.5	ABFS: OAuth Databricks: Personal Access Token and Managed Identity

To use Databricks 10.4 LTS, you must update the following properties in Databricks Advance Properties.

Property	Value

Property	Value
spark.sql.caseSensitive	false
spark.hadoop.spark.sql.caseSensitive	false

To use Databricks 14.3 LTS, you must update the following properties in Databricks Advance Properties.

Databricks 14.3 LTS is certified for Kyvos Enterprise.

Property	Value

Property	Value
spark.sql.caseSensitive	false
spark.hadoop.spark.sql.caseSensitive	false
spark.sql.parquet.inferTimestampNTZ.enabled false	false
spark.hadoop.spark.sql.parquet.inferTimestampNTZ.enabled false	false
spark.sql.legacy.parquet.nanosAsLong false	false
spark.hadoop.spark.sql.legacy.parquet.nanosAsLong false	false

Supported Databricks instance types

Worker type: Edsv4 size series (recommended E16dsv4)
1. Min Worker: 2
2. Max Workers: 10
Driver Type: Edsv4 size series (recommended E8dsv4)

Important

From Kyvos 2024.12 onwards, automated deployment of clusters is supported in environments where a system-assigned managed identity is pre-configured before deployment.
From Kyvos 2024.3.x onwards,
- Databricks version 14.3 LTS is supported for Kyvos Enterprise.
- The azcopy version is upgraded from 10.16 to 10.25.
From Kyvos 2024.2 onwards, for Azure, Kyvos will only support Generation 2 VMs for fresh deployments.
From Kyvos 2023.5 onwards, Databricks SQL warehouse for ROLAP queries is supported.
From Kyvos 2023.5, Flexible Server version 13 is supported for both new deployments and upgrades.
Cuboid replication type - Local and ABFS (ADLS Gen2) are supported. Recommended replication type is Local.
Kyvos supports Standard_Ds_v4 size series VM type for BI Server and Standard_Es_v4 size series type for Query Engines.