You need to Taints allow you to mark nodes with specific restrictions, so pods will only be scheduled on them if they have corresponding tolerations.
Shared Kubernetes and Dedicated pool
Adding taints and configuring tolerations is needed.
If using a shared Kubernetes cluster with a dedicated user node pool, ensure that the user node pool has dedicated taints.
After creating taints, you must configure tolerations for Kyvos worker pods through Kyvos Manager in the kyvos-compute-worker-job.yaml.template file. This is applicable for all clouds (AWS, Azure and GCP).
Prerequisites for creating taints (GCP)
If you do not have taints created for GCP, perform the steps mentioned below in this section if you want to run Kyvos worker pods on a specific node pool.
Prerequisites
You Ensure the user adding the taints must have the required IAM permissions to addtaints:
Editor or roles/container.admin or a custom role with sufficient permissions.
A separate Node pool is required to run system poolspods. Create a Node pool with the ‘n2-highmem’ configuration with Autoscaling disabled and count as 1.
| Panel | ||||||
|---|---|---|---|---|---|---|
| ||||||
Note The above-created node pool must be up and running before scheduling a semantic model process. |
For configuration, two separate node pools are required with different taints added to each node pool. For more information, refer to Adding taints to Node pool
Modify kyvos job yaml
After adding taints to Node pool, configure tolerations in the kyvos worker's YAML specification. Tolerations allow pods created by the job to be scheduled on nodes with matching taints.
...
Login to Kyvos Manager.
...
Navigate to the Utilities > Manage Configuration Files.
...
To configure taints as per your requirement, modify the kyvos-compute-worker-job.yaml.template.
...
Download the kyvos-compute-worker-job.yaml.template file. In the kyvos-compute-worker-job.yaml.template file, you will find the below section. In the section, configure the key and value with the taints configured in Step 2.
tolerations:
key: "key1"
operator: "Equal"
value: "value1"
effect: "NoSchedule"
...
Then, navigate to Kyvos and Ecosystem > Compute Cluster and reapply the configuration to make it effective.
...
After configuring the tolerations, reapply the configurations from the Kyvos Native Page using Force Apply.
Add taints to a node pool
...
.
Add taints to a node pool
Adding Taints to a New Node Pool (GCP)
When creating a new node pool, you can add taints during the creation process through:
Command-Line:
gcloud container node-pools create NODE_POOL_NAME \
--cluster=CLUSTER_NAME \
--node-taints=KEY=VALUE:NoSchedule \
--num-nodes=NUMBER_OF_NODESConsole:
Follow steps to create a new node pool.
Specify the taints in the Node taints section.
Adding Taints to an Existing Node Pool for GCP
Option 1: Using gcloud Command
...
Go to the GKE Clusters page.
Click your cluster's name.
Navigate to the Node Pools tab.
Click the pencil/edit icon next to the node pool you want to modify.
Add the taints under the Node taints section.
Save the changes.
Adding Taints to a New Node Pool
When creating a new node pool, you can add taints during the creation process through:
...
Additional Notes
If you want to add multiple taints, separate them with commas: --node-taints=
...
KEY1=
...
VALUE1:NoSchedule
...
Console:
Follow steps to create a new node pool.
Specify the taints in the Node taints section.
Additional Notes
If you want to add multiple taints, separate them with commas: --node-taints=KEY1=VALUE1:NoSchedule,KEY2=VALUE2:NoSchedule
,KEY2=VALUE2:NoSchedule
Configure Tolerations
After adding taints to Node pool, configure tolerations in the kyvos worker's YAML specification. Tolerations allow pods created by the job to be scheduled on nodes with matching taints.
Login to Kyvos Manager.
Navigate to the Utilities > Manage Configuration Files.
To configure taints as per your requirement, modify the kyvos-compute-worker-job.yaml.template file.
Download the kyvos-compute-worker-job.yaml.template file. In the kyvos-compute-worker-job.yaml.template file, add the below section at the bottom of the file.
tolerations:
Replace KEY and VALUE with the required taint details.
Replace it in the kyvos-compute-worker-job.yaml.template file underthe KYVOSMANAGER_PATH/cloud/gcp/terraform/kyvos-k8s/ section.
| Panel | ||||||
|---|---|---|---|---|---|---|
| ||||||
Note The path varies for each cloud. In the above-step, the path is mentioned for GCP. |
After configuring the tolerations, navigate to Kyvos and Ecosystem > Compute Cluster and then click Save to reapply the configuration to make it effective.