Supported Operating Systems
Platform | Supported OS |
---|---|
On-premise |
|
AWS | Default: Amazon Linux 2 Also supported:
|
Azure | Default: RHEL 8.6 Also supported:
|
GCP | Default: CentOS 7.9 |
Supported clusters
You can install Kyvos 2023.3 on any of the following clusters.
RHEL 8.6 is supported from Kyvos 2023.1 onwards for AWS and Azure.
On-premises
Kyvos 2023.3 release is supported on the following on-premises clusters.
Hadoop provider | Provider/ | Deployment mode | Spark version | Hive version | Hadoop Security | Authorization |
---|---|---|---|---|---|---|
Cloudera | 6.3/3.0 | YARN/Non-YARN | Spark 2.4 | 2.1 | No | No |
CDP | 7.1.8/3.1 | YARN/Non-YARN | Spark 2.4 | 3.1 | Yes | Yes |
Cuboid replication types – Local, None, are certified with CDH (Cloudera Distribution for Hadoop) and CDP clusters.
AWS
Kyvos 2023.3 release is supported on the following AWS cluster.
Platform | Service Version | Deployment Mode | Hadoop | Execution Engine | Security |
---|---|---|---|---|---|
AWS-EMR with and without Glue | V-6.10 | Non-YARN | v2.8.4 | Spark 3.4 | KMS, IAM Roles policies on S3 |
Kyvos 2023.3 release provides AWS Databricks support for the following:
Platform | Provider version | Deployment mode | File source | Execution engine | Security |
---|---|---|---|---|---|
Databricks | 10.4 LTS | Non-YARN | S3 | Spark 3.4 | KMS, IAM Roles policies on S3 |
To use Databricks 10.4 LTS, you must update the following properties in Databricks Advance Properties.
Property | Value |
---|---|
spark.sql.caseSensitive | false |
spark.hadoop.spark.sql.caseSensitive | false |
From Kyvos 2023.2, only AWS EMR version 6 .10 with Livy is supported.
Read more: Supported AWS Configurations on Kyvos 2023.3
Important
Cuboid replication type – Local and S3 are supported for Amazon EMR Clusters. Recommended replication type is Local.
When using RDS, Postgres version 13.11 is supported for both new deployments and upgrades. Support for version 13.6 is discontinued.
Support of RDS with TLS is not certified.
Graviton instances are only supported for AWS EMR clusters.
From Kyvos 2023.2 onwards, AWS EMR clusters will be created using Graviton-based instances by default.
To support Graviton for Kyvos resources, manually replace the JRE for Kyvos and Kyvos Manager with a Graviton-compatible JRE. Alternatively, users can contact Kyvos support to create a customized
Graviton setup, including Graviton-compatible JREs. This setup is available on-demand but requires manual updating of the path for the setup bundle in the generated CFT template that is generated from the Kyvos Manager Wizard.
Azure
Kyvos 2023.3 release is supported on the following Azure clusters.
Platform | Provider version | Deployment mode | File source | Execution engine | Security |
---|---|---|---|---|---|
Databricks | 10.4 LTS | Non-YARN | ABFS | Spark 3.4 |
|
Read more: Supported Azure Configurations on Kyvos 2023.3
To use Databricks 10.4 LTS , you must update the following properties in Databricks Advance Properties.
Property | Value |
---|---|
spark.sql.caseSensitive | false |
spark.hadoop.spark.sql.caseSensitive | false |
Info
From Kyvos 2023.2, only Databricks version 10.4 LTS is supported.
Kyvos 2023.3 release is certified for using Spot instances with Databricks version 10.4 LTS.
Cuboid replication type - Local and ABFS (ADLS Gen2) are supported. Recommended replication type is Local.
Supported Postgres version when using Azure-based PostgresSql is 11 for both new deployments and upgrades.
Google Cloud Platform
Kyvos 2023.3 release is supported on the following Google Cloud Platform clusters.
Platform | Provider version | Deployment mode | Hadoop | File source | Execution engine | Cluster security |
---|---|---|---|---|---|---|
Dataproc | 2.1.11-debian11 | Non-YARN | v3.2 | GFS | Spark 3.4 | No |
Read more: Supported GCP Configurations on Kyvos 2023.3
Info
Cuboid replication type - Local and GS are supported. You need to deploy the Zookeeper service on the BI Server node. Recommended replication type is Local.
From Kyvos 2023.2, only Dataproc version 2.1.11 with Livy is supported.
GCP Dataproc is only certified with non-preemptible VM instances.
To work with Dataproc 2.0, you need to add the property
dataproc.yarn.logs.path.version
to the Default Hadoop Connection properties.
Postgres Versions
Postgres | Version |
---|---|
Bundled | v13.3 |
For AWS (with RDS) | v13.11 |
For Azure (with Azure-based PostgresSql) | v11 |
Supported data warehouse on Cloud platforms
Snowflake | Redshift | Databricks | BigQuery | Azure SQL DB | Oracle RDS | Teradata | |
---|---|---|---|---|---|---|---|
AWS | Yes | Yes | Yes | Yes | No | Yes | Yes |
Azure | Yes | No | Yes | No | Yes | No | No |
GCP | Yes | No | No | Yes | No | No | No |
Important information
From the Kyvos 2023.1 release onwards, only Postgres (either bundled or external) is the supported repository for Kyvos Manager. The support for Derby as a Kyvos Manager repository is discontinued
Kyvos recommends using SSD disk type for better query response time
With the 2023.2 release, the Kyvos Corretto JRE version is updated to VM Corretto 8.372.08.1. For Kyvos Manager, the supported Corretto JRE version is 17.0.7.7.1.
Tomcat versions:
For Kyvos 2023.2 onwards: Kyvos application works with Tomcat 9.0.75, and Kyvos Manager works with 10.1.9
Kyvos 2023.1.x onwards following browsers are certified:
For Mac, Kyvos is supported for Safari and Chrome browsers
Supported Chrome version to allow PDF exports from the Kyvos Web portal: 114.0.5735.198
For Windows, Kyvos is certified only for Chrome browsers
Kyvos screens are responsive, and dashboard elements adjust as per screen resolutions. Kyvos is best viewed on a minimum resolution of 1366*768 pixels
Release 2023.1 onwards, Kyvos comes with:
Bundled Postgres version 13.3
Graviton CPU is supported for Kyvos with repository service RDS only
Support for log4j version to 2.17.1 to overcome the log4j vulnerability
Certified CLI versions: Azure - 10.16.2
Certified upgrade versions: You can upgrade your Kyvos version to 2023.3 from the following versions:
2023.1.x
2023.2.x
Support for Spark Driver 2.06.9 was discontinued from Kyvos 2023.1
Read more: