You can use no Spark model processing to deploy Kyvos through Query Engine or Kubernetes for Azure and GCP. For
AWS
...
: You can use no Spark model processing to deploy Kyvos through Query Engine.
...
Azure:
GCP: For Kubernetes, Kyvos builds the semantic model using Google Cloud's managed service GKE (Google Kubernetes Engine). The GKE cluster is deployed through Google Deployment Manager scripts. Using the scripts, you can select a No-Spark-based cluster or process the semantic model using Spark Mode. Currently, to proceed with a no-spark-based deployment mode, you must use a Dataproc cluster (either new or existing).
For more details about how to deploy Kyvos on GCP using the no-Spark model, see the following section:
To deploy Kyvos through Query Engine
Azure:
- GCP:
Post deployment for all clouds (AWS, Azure and GCP)
...
Add the kyvos.connection.readUsingCustomFS.jobs.internal=NONE property from the Kyvos connections page
Modify the values of the following properties in the advance properties of semantic model job:
kyvos.process.compute.type=KYVOS_COMPUTE
kyvos.build.aggregate.type=TABULAR
Set the kyvos.process.datastore.propertiesproperty properties propertyon Hadoop Connection properties and set the value as SET disabled_optimizers = 'join_order';SET memory_limit='40GB';SET threads TO 1;
Restart Kyvos services.
...