| Aura tab |
|---|
| summary | AWS |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJBV1MlMjIlN0Q= |
|---|
|
SSH to EC2 instance from sudo user. Copy and paste the below commands in the terminal: | Code Block |
|---|
sudo -i
sudo sed -i 's/PasswordAuthentication no/PasswordAuthentication yes/g' /etc/ssh/sshd_config
rm -rf /home/kyvos/.ssh/authorized_keys
rm -rf /home/centos/.ssh/authorized_keys
sudo passwd $user
Enter the password you want to set
sudo passwd centos
Enter the password you want to set
sudo service sshd restart |
Close the terminal and use the password to SSH. Run the below command from root user to add a linux user and give permissions: | Code Block |
|---|
sudo useradd -m $user
sudo passwd $user
sudo usermod -a -G $user $user |
Increase ulimit of Linux User user on all nodes using the command: | Code Block |
|---|
echo $user hard nofile 524288 >> /etc/security/limits.conf
echo $user hard nofile 524288 >> /etc/security/limits.d/20-nproc.conf
echo $user soft nofile 524288 >> /etc/security/limits.conf
echo $user soft nofile 524288 >> /etc/security/limits.d/20-nproc.conf |
Add $user in /etc/cron.allow | Code Block |
|---|
cd /var/spool/cron/
touch $user |
Make the Linux user owner of these directories, using the command: | Code Block |
|---|
chown -R $user:$user /data/kyvos/app
chown -R $user:$user /data/kyvos/installs
chown -R $user:$user /mnt/s3
sudo chown -R $user:$user /var/spool/cron/$user |
Use the JRE shipped with the Kyvos bundle (recommended), modify the /home/$user/.bashrc using the below command from $user.
| Code Block |
|---|
cd
vi .bashrc
export PATH=<install path>/kyvosmanager_war/kyvosmanager/jre/bin/:$PATH
source .bashrc |
Adding Step for EMR
| Panel |
|---|
| panelIconId | atlassian-info |
|---|
| panelIcon | :info: |
|---|
| bgColor | #FFFAE6 |
|---|
| Important This information mentioned-below are only applicable for Spark-based deployments. |
To create a user directory for the Deployment user on HDFS, you need to Add Step in EMR. NOTE: Replace $USER with the user being used for Kyvos deployment. Click Add Step on the existing EMR.
 On the Step screen, enter details as: Step type: Select the Custom JAR option. Name: Create temp directory for $USER on HDFS. JAR location: Provide the value as command-runner.jar Arguments: Provide the value as bash -c "sudo -u hdfs hadoop fs -mkdir -p /user/$USER/tmp; sudo -u hdfs hadoop fs -chmod -R 777 /user/$USER" Action on failure: Select the Continue option.
Click the Add button.  Restart BI Server so that EMR changes get synchronized with BI Server. Delete the Temp folder
| Aura tab |
|---|
| summary | Azure |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJBenVyZSUyMCUyMiU3RA== |
|---|
|
SSH to Azure VM using sudo user. | Code Block |
|---|
sudo -i
sudo sed -i 's/PasswordAuthentication no/PasswordAuthentication yes/g' /etc/ssh/sshd_config
rm -rf /home/kyvos/.ssh/authorized_keys
rm -rf /home/adminuser/.ssh/authorized_keys
sudo passwd $user
Enter the password you want to set
sudo passwd adminuser
Enter the password you want to set
sudo service sshd restart |
Copy the below commands on the terminal: Close the terminal and use the password to SSH. Run the below command from the root user to add a Linux user and give permissions: | Code Block |
|---|
sudo useradd -m $user
sudo passwd $user
sudo usermod -a -G $user $user |
Increase ulimit of Linux User user on all nodes using the command:
| Code Block |
|---|
echo $user hard nofile 524288 >> /etc/security/limits.conf
echo $user hard nofile 524288 >> /etc/security/limits.d/20-nproc.conf
echo $user soft nofile 524288 >> /etc/security/limits.conf
echo $user soft nofile 524288 >> /etc/security/limits.d/20-nproc.conf |
Add $user in /etc/cron.allow using the command: | Code Block |
|---|
cd /var/spool/cron/
touch $user |
Make Linux user owner of these directories using the command:
| Code Block |
|---|
chown -R $user:$user /data/kyvos/app
chown -R $user:$user /data/kyvos/installs
sudo chown -R $user:$user /var/spool/cron/$user |
To use the JRE shipped with the Kyvos bundle (recommended), modify the /home/$user/.bashrc using the below command from $user: | Code Block |
|---|
cd
vi .bashrc
export PATH=<install path>/kyvosmanager_war/kyvosmanager/jre/bin/: /data/kyvos/installs/bin:$PATH
export HD_INSIGHT_BINARIES=<install path>/hdinsights/lib
export JAVA_HOME=/data/kyvos/app/jre
source .bashrc |
| Aura tab |
|---|
| summary | GCP |
|---|
| params | JTdCJTIydGl0bGUlMjIlM0ElMjJHQ1AlMjIlN0Q= |
|---|
|
SSH to GCP VM from sudo user. Copy and paste the below commands in the terminal: | Code Block |
|---|
sudo -i
sudo sed -i 's/PasswordAuthentication no/PasswordAuthentication yes/g' /etc/ssh/sshd_config
rm -rf /home/kyvos/.ssh/authorized_keys
sudo passwd $user
Enter the password you want to set
sudo service sshd restart |
Close the terminal and use the password to SSH. Run the below command from the root user to add a Linux user and give permissions: | Code Block |
|---|
sudo useradd -m $user
sudo passwd $user
sudo usermod -a -G $user $user |
Increase ulimit of Linux User user on all nodes using the command: | Code Block |
|---|
echo $user hard nofile 524288 >> /etc/security/limits.conf
echo $user hard nofile 524288 >> /etc/security/limits.d/20-nproc.conf
echo $user soft nofile 524288 >> /etc/security/limits.conf
echo $user soft nofile 524288 >> /etc/security/limits.d/20-nproc.conf |
Add $user in /etc/cron.allow | Code Block |
|---|
cd /var/spool/cron/
touch $user |
Make Linux user owner of these directories. | Code Block |
|---|
chown -R $user:$user /data/kyvos/app
chown -R $user:$user /data/kyvos/installs
sudo chown -R $user:$user /var/spool/cron/$user |
Use the JRE shipped with the Kyvos bundle (recommended), modify the /home/$user/.bashrc using the below command from the root user.
| Code Block |
|---|
cd /home/$user
vi .bashrc
export PATH=<install path>/kyvosmanager_war/kyvosmanager/jre/bin/:$PATH
source .bashrc |
On the Master node of Dataproc, run the below commands on the terminal: | Code Block |
|---|
hadoop fs -mkdir -p /user/$user/temp
hadoop fs -chmod -R 777 /user/$user |
| 
