Query Engine YARN Configuration

Applies to: Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

If the cluster is deployed in YARN mode, Kyvos Manager enables you to configure the YARN services for Query Engines.

Note

From Kyvos 2023.3 onwards, you can see the last operation details, including progress status and start time, by clicking the i icon. To view more comprehensive details, simply click the View Details link, which will take you to the Operations page, where you can view the operation information in detail.

For this, click the cluster name > Kyvos and Ecosystem > Query Engine (in YARN) on the navigation pane.
Here you can configure YARN-based Query Engines settings such as:

Area	Parameter/Field	Description/Remarks
Application Master Configuration	YARN Job Name:	Specify a name for the YARN job.
	YARN Queue Name	Specify the YARN Queue name.
	Application Master Core	Specify the memory configuration for the application master node.
	Application Master Log Path	Specify the path for generating Application Master logs for the YARN cluster.
Application Master Schedule	Restart Application Master	Specify the schedule for restarting the application master.
Query Engine YARN Configuration	Operation Mode	Select Count Based or Host Based option.
	Nodes	If you have selected the Host Based option, specify the Host Name and Instance Count for the nodes.
	Query Engine Instance Count	If you have selected the Count Based option, specify the number of Query Engine instances to be launched.
	Container Core	Enter the number of virtual cores to be used by Kyvos Query Engine and specify the memory for each core.
	Log Path	Enter the path for saving Query Engine logs. Ensure that the path exists on data nodes and the user (with which YARN containers are launched) has write permissions on this path
	Log Sync Schedule	Enter the time interval for syncing Query Engine logs on HDFS.
Query Engine Schedule	Enable Schedule	Select this check box to enable the scheduling of Query Engines.
	Additional Query Engine Nodes	Enter additional minimum Query Engine hostnames (if any) and the corresponding instance count. This is displayed only when Scheduling of Query Engines is enabled
	Select Query Engines to Exclude from Schedule	If you want to exclude any Query Engines from the schedule, select them from the list here.