Creating external resources for Kyvos on Azure

Applies to: Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace

Kyvos Azure Marketplace Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)

You can create the Kyvos resources externally on Azure. For this, perform the steps mentioned in the sections below.

Note

Download the Azure Installation Files folder and keep all the requisite files handy.

Kyvos Manager Node

To create the Kyvos Manager node, perform the following steps.

Go to Azure Portal.
Click create a virtual machine.
Select the Subscription and Resource Group that you want to use.
Provide the Virtual Machine name.
From the Image drop-down, choose the Red Hat Enterprise Linux 8.6 - Gen 1 option (recommended).
Change the Username to adminuser
In SSH public key source, use the existing public key and put its value, and click Next.
Create and attach a disk for the Kyvos Manager node, and click Next.
Choose Virtual Network, Subnet, and Public IP (if needed).
In NIC network Security Group, click Advance and then select a Security Group. Click Next.
Add tags (optional).
Click Review and Create.
Once the machine is created, SSH on it using the credentials for the adminuser.
Switch to root user using sudo -i
Go to /tmp location and create a file using nano. Example- nano script.sh
Download the azure_km_boot.sh script from the Azure Installation Files folder.
Copy and paste the content of the script in the script.sh that you created (step 15) and save it.
NOTE: The deployment user is any user other than kyvos, change the value of the deployment user in the script.
Give executable permission to script.sh using chmod 777 script.sh command
Then use ./script.sh to run the script.

Run the following commands.

yum update -y --disablerepo='*' --enablerepo='*microsoft*'
yum install -y keyutils
AZCOPY_DOWNLOAD_URL=`curl -s -D- https://aka.ms/downloadazcopy-v10-linux | grep ^Location |  awk '{print $2}' | tr -d '\r'`
curl -o /tmp/azcopy.tar.gz $AZCOPY_DOWNLOAD_URL
cd /tmp/ && tar -xzvf /tmp/azcopy.tar.gz

Switch to Deployment user, then go to /data/kyvos/installs location and run the following commands:

export CLIENT_SECRET={Enter the Bundle download Client Secret}

export AZCOPY_SPA_CLIENT_SECRET=$CLIENT_SECRET && /tmp/azcopy*/azcopy login --service-principal --application-id 78df1698-2e9e-40c9-befe-ea2203788da2 --tenant-id b9dfa905-6761-4a54-8aa0-7b7647bbafb8 && /tmp/azcopy*/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/2023.2/prereq/kyvosprereq.tar.gz /data/kyvos/installs/

tar -xzvf kyvosprereq.tar.gz

rm -rf kyvosprereq.tar.gz jre/

Run the below command with the root user.

keyctl new_session && /data/kyvos/installs/bin/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/2023.2/fontconfig/fontconfig-2.13.0-4.3.el7.x86_64.rpm /tmp/
echo yes | yum localinstall /tmp/fontconfig*.rpm

Run the below command with the deployment user.

AZCOPY_PATH="/data/kyvos/installs"
$AZCOPY_PATH/bin/azcopy login --identity && $AZCOPY_PATH/bin/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/commons/kubectl $AZCOPY_PATH/bin/ --recursive
chmod 777 $AZCOPY_PATH/bin/kubectl

Switch to Deployment user, then go to /data/kyvos/installs location and run the following commands:

KyvosBundleName=`export AZCOPY_SPA_CLIENT_SECRET=$CLIENT_SECRET && /data/kyvos/installs/bin/azcopy login --service-principal --application-id 78df1698-2e9e-40c9-befe-ea2203788da2 --tenant-id b9dfa905-6761-4a54-8aa0-7b7647bbafb8 && /data/kyvos/installs/bin/azcopy list https://kyvosjarsservice.blob.core.windows.net/kyvossetup/2023.2/latest/`

KyvosBundleName=`echo $KyvosBundleName | grep -oP 'Kyvos[^[:blank:]]*' | awk -F '.tar.gz' '{print $1".tar.gz"}' | head -1`

export AZCOPY_SPA_CLIENT_SECRET=$CLIENT_SECRET && /data/kyvos/installs/bin/azcopy login --service-principal --application-id 78df1698-2e9e-40c9-befe-ea2203788da2 --tenant-id b9dfa905-6761-4a54-8aa0-7b7647bbafb8 && /data/kyvos/installs/bin/azcopy copy https://kyvosjarsservice.blob.core.windows.net/kyvossetup/2023.2/latest/$KyvosBundleName /data/kyvos/installs/

tar -xzvf $KyvosBundleName
 
rm -rf $KyvosBundleName

Run the below command with the root user. Replace $user with the deployment user name.
```
chown -R  $user:$user /data/kyvos/
```

Switch to $user and run the following command:

Go to /data/kyvos/installs/kyvosmanager_war/kyvosmanager/bin

Start the Kyvos Manager from the terminal.

Note

To use the Flexible Server for Kyvos Manager, perform the following steps.

Configure the jdbc.properties of Kyvos Manager (manually) with the Flexible Server details, do the following:

Before configuring the jdbc.properties, ensure that Kyvos Manager must not be started.
Replace the server name in jdbc url with the server name of the Flexible server.
jdbc.username must be kmdbuser.
Set the value of useBundledRepo and manageBundledRepoService to ‘false.’
After completing the above steps, now start the Kyvos Manager using the the ./start-km.sh command.

Kyvos Web Portal, BI Server and Query Engine Nodes

Go to Azure Portal.
Click On create a virtual machine.
Select Subscription, Resource Group, and provide the Virtual Machine name.
In the Image drop-down, select the Red Hat Enterprise Linux 8.6 - Gen 1 option (recommended).
Change the Username to adminuser
In SSH public key source, use existing public key and put its value, and click Next.
Create and attach a disk for BI/QE Installation, and click Next.
Choose Virtual Network, Subnet, and Public IP (if needed).
In NIC network Security Group, click Advance and then select a Security Group.
Click Next.
Add tags and click Review and Create.
Once the machine is created, ssh on it using credentials for the adminuser.
Switch to root user using sudo -I
Go to /tmp
Create a file using nano. Example- nano script.sh
Download the azure-bi-boot and azure-qe-boot script from the Azure Installation Files folder.
NOTE: If you download the script for Query Engine, you must specify the QE_DATA_DISK_SIZE parameter in the script.
Copy and paste the content of the script into the script.sh file (created in Step 15) and save it.
Give executable permission to script.sh using chmod 777 script.sh command.
Then use ./script.sh to run the script.

Run the following commands one by one.

Install azcopy using the following commands. Replace $user with the deployment user name.

yum update -y --disablerepo='*' --enablerepo='*microsoft*'
yum install -y keyutils
AZCOPY_DOWNLOAD_URL=`curl -s -D- https://aka.ms/downloadazcopy-v10-linux | grep ^Location | awk '{print $2}' | tr -d '\r'`
curl -o /tmp/azcopy.tar.gz $AZCOPY_DOWNLOAD_URL
tar -xzvf /tmp/azcopy.tar.gz

Switch to Deployment user, then go to /data/kyvos/installs location and run the following commands:

export CLIENT_SECRET={Enter the Bundle download Client Secret}
export AZCOPY_SPA_CLIENT_SECRET=$CLIENT_SECRET && /tmp/azcopy*/azcopy login --service-principal --application-id 78df1698-2e9e-40c9-befe-ea2203788da2 --tenant-id b9dfa905-6761-4a54-8aa0-7b7647bbafb8 && /tmp/azcopy*/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/2023.5/prereq/kyvosprereq.tar.gz /data/kyvos/installs/

Run the below command with the root user.
```
 rm -rf /tmp/azcopy*
```
Switch to Deployment user, then go to /data/kyvos/installs location and run the following commands:
```
tar -xzvf kyvosprereq.tar.gz
rm -rf kyvosprereq.tar.gz jre/
```

Run the below command with the root user.

keyctl new_session && /data/kyvos/installs/bin/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/2023.5/fontconfig/fontconfig-2.13.0-4.3.el7.x86_64.rpm /tmp/

echo yes | yum localinstall /tmp/fontconfig*.rpm
chown -R  $user:$user /data/kyvos/

Run the below command with deployment user.

AZCOPY_PATH="/data/kyvos/installs" 
$AZCOPY_PATH/bin/azcopy login --identity && $AZCOPY_PATH/bin/azcopy copy https://kyvosjarsservice.blob.core.windows.net/thirdparty/commons/kubectl $AZCOPY_PATH/bin/ --recursive
chmod 777 $AZCOPY_PATH/bin/kubectl

Configure environment variables for the Deployment user, using the commands:

cd 
vi .bashrc 
export PATH=<install path>/kyvosmanager_war/kyvosmanager/jre/bin/: /data/kyvos/installs/bin:$PATH 
export JAVA_HOME=/data/kyvos/app/jre 
source .bashrc