Multiple process and read connections

Applies to: Kyvos Enterprise  Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace   Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

Kyvos allows you to use separate process and read connections, as well as multiple process connections on AWS, Azure, and GCP platforms. This helps user groups across organizations to use separate clusters and hence improve semantic model process time as the resources are not shared across a larger group, and also each group will be able to get an estimate of their own usage. 

• Is Data Process – This connection holds the data on which the semantic model will be processed.  

• Use as Source – This connection will primarily be used for reading purposes like semantic model process and data profiling jobs. However, you can also mark a process connection as a read connection, as it can be used for creating datasets and designing semantic models.

You need to create a base process connection during the deployment and subsequently add a new process connection through Kyvos. The new connection must have the same configuration in terms of cluster version, Hadoop, Hive, and Spark versions.

When you define a new connection, you will see the option to choose if it is a Use as Source connection.

If you have configured multiple process connections, you can choose the connection to be used for launching the process jobs at the time of scheduling processes.

By default, all  Warehouse connections are Use as a Source  connections, which can only be used to read data for registering files.