Azure
The following Azure configurations are supported for Kyvos 2025.1 release:
Platform | Provider version | Deployment mode | File source | Execution engine | Security |
|---|---|---|---|---|---|
Databricks | 10.4 LTS | Non-YARN | ABFS | Spark 3.4 |
|
Databricks | 14.3 LTS | Non-YARN | ABFS | Spark 3.5 |
|
To use Databricks 10.4 LTS, you must update the following properties in Databricks Advance Properties.
Property | Value |
|---|---|
spark.sql.caseSensitive | false |
spark.hadoop.spark.sql.caseSensitive | false |
To use Databricks 14.3 LTS, you must update the following properties in Databricks Advance Properties.
Databricks 14.3 LTS is certified for Kyvos Enterprise.
Property | Value |
|---|---|
spark.sql.caseSensitive | false |
spark.hadoop.spark.sql.caseSensitive | false |
spark.sql.parquet.inferTimestampNTZ.enabled false | false |
spark.hadoop.spark.sql.parquet.inferTimestampNTZ.enabled false | false |
spark.sql.legacy.parquet.nanosAsLong false | false |
spark.hadoop.spark.sql.legacy.parquet.nanosAsLong false | false |
Supported Databricks instance types
Worker type: Edsv4 size series (recommended E16dsv4)
Min Worker: 2
Max Workers: 10
Driver Type: Edsv4 size series (recommended E8dsv4)
Important
From Kyvos 2025.1 onwards,
The Postgres version is upgraded to 16.3 for both new deployments and upgrades. The Postgres version 13.11 is approaching its end of life.
The RHEL 9.4 version is also supported for wizard-based deployments.
Standard_Es_v4 size series VM type along with Standard_Ds_v4 is supported. However, It is recommended to use Standard_Ds_v4.
From Kyvos 2024.12 onwards, automated deployment of clusters is supported in environments where a system-assigned managed identity is pre-configured before deployment.
From Kyvos 2024.3.x onwards,
Databricks version 14.3 LTS is supported for Kyvos Enterprise.
The azcopy version is upgraded from 10.16 to 10.25.
From Kyvos 2024.2 onwards, for Azure, Kyvos will only support Generation 2 VMs for fresh deployments.
From Kyvos 2023.5 onwards, Databricks SQL warehouse for ROLAP queries is supported.
From Kyvos 2023.5, Flexible Server version 13 is supported for both new deployments and upgrades.
Cuboid replication type - Local and ABFS (ADLS Gen2) are supported. Recommended replication type is Local.
Kyvos supports Standard_Ds_v4 size series VM type for BI Server and Standard_Es_v4 size series type for Query Engines.