Connection Property: kyvos.spark.deployment.mode
- NIDHI BHANDARI
- DocReviewer
Owned by NIDHI BHANDARI
Description:
This property sets the spark deployment mode. In yarn-cluster mode, the Spark driver runs inside an application master process which is managed by YARN on the cluster, and the client can go away after initiating the application. In yarn-client mode, the driver runs in the client process, and the application master is only used for requesting resources from YARN. It is valid only when execution engine is set to spark.
Values and behavior:
yarn-cluster. yarn-client, local
Syntax:
Default value:
yarn-cluster
Scope:
Comes into effect:
Dependencies and related properties:
Recommendation:
Copyright Kyvos, Inc. All rights reserved.