Query Engine YARN Configuration
Applies to: Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace
Kyvos Azure Marketplace  Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)
If the cluster is deployed in YARN mode, Kyvos Manager enables you to configure the YARN services for Query Engines.
Note
From Kyvos 2023.3 onwards, you can see the last operation details, including progress status and start time, by clicking the i  icon. To view more comprehensive details, simply click the View Details link, which will take you to the Operations page, where you can view the operation information in detail.Â
For this, click the cluster name > Kyvos and Ecosystem > Query Engine (in YARN) on the navigation pane.
Here you can configure YARN-based Query Engines settings such as:
Area | Parameter/Field | Description/Remarks |
---|---|---|
Application Master Configuration | YARN Job Name: | Specify a name for the YARN job. |
YARN Queue Name | Specify the YARN Queue name. | |
Application Master Core | Specify the memory configuration for the application master node. | |
Application Master Log Path | Specify the path for generating Application Master logs for the YARN cluster. | |
Application Master Schedule | Restart Application Master | Specify the schedule for restarting the application master. |
Query Engine YARN Configuration | Operation Mode | Select Count Based or Host Based option. |
Nodes | If you have selected the Host Based option, specify the Host Name and Instance Count for the nodes. | |
Query Engine Instance Count | If you have selected the Count Based option, specify the number of Query Engine instances to be launched. | |
Container Core | Enter the number of virtual cores to be used by Kyvos Query Engine and specify the memory for each core. | |
Log Path | Enter the path for saving Query Engine logs. Ensure that the path exists on data nodes and the user (with which YARN containers are launched) has write permissions on this path | |
Log Sync Schedule | Enter the time interval for syncing Query Engine logs on HDFS. | |
Query Engine Schedule | Enable Schedule | Select this check box to enable the scheduling of Query Engines. |
Additional Query Engine Nodes | Enter additional minimum Query Engine hostnames (if any) and the corresponding instance count. This is displayed only when Scheduling of Query Engines is enabled | |
Select Query Engines to Exclude from Schedule | If you want to exclude any Query Engines from the schedule, select them from the list here. |
Copyright Kyvos, Inc. All rights reserved.