Applies to:
...
...
Kyvos
...
Enterprise
...
Kyvos Cloud (
...
SaaS on AWS)
...
Kyvos AWS Marketplace
...
Kyvos Azure Marketplace
...
Kyvos AWS Marketplace GCP Marketplace Kyvos Single Node Installation (Kyvos SNI) Kyvos Free (Limited offering for AWS)
...
This section provides information on the validations that must be performed by the DevOps team after cluster deployment.
Ensure all EC2 instances are up and running.
The cluster should be completed with BI Server, Query Engines, Web server, Kyvos Manager servers, and Bastion Host.
Login to the AWeb Server console then go to EC2 service and check all instances like BI Server, Query Engines, Web server, Kyvos Manager servers, and Bastion Host.
...
Ensure CFT deployed two BI Server, five Query Engines, one Web server, one Kyvos Manager server, and one Bastion Host
In the cluster, there should be two BI Server, five Query Engines, one Web server, one Kyvos Manager server, and one Bastion Host as Jump host.
Five Query Engines:
...
Two BI Servers:
...
One Web Server (secondary web portal, this instance will be used to run the Kyvos web portal):
...
One Kyvos Manager server (Primary web server, this instance will be used to run the Kyvos web portal and Kyvos Manager):
...
One Bastion Host:
...
Ensure BI servers are in different AZ’s
...
Check both BI severs, it should be in different availability zone as in below screenshot:
...
Here, BI1 is in us-eat-2b AZ and BI2 is in us-east-2a AZ
...
Three Query Engines should be in AZ1, and two Query Engines should be in AZ2.
...
Example, us-east-2a is AZ1 and us-ease-2b is AZ2.
...
Web Server1 instance should be in one region and Kyvos Manager instance should be in another region
Kyvos Manager instance:
...
Web Server1 instance:
On the above screenshots, the Kyvos Manager instance is in us-east-2b, and Web Server1 is in us-east-2a.
...
Autoscaling should be enabled on Bastion host
...
Refer to section Bastion Host autoscaling.
...
Ensure all EC2 instances are attached to a security group <To be removed, as per now it's not required>
...
Login to the AWS EC2 console and search cluster name, and apply the filter with the security group. Check all EC2 instances should be attached to a security group.
...
Check S3 replication is enabled If DR is enabled
...
In the primary cluster, S3 bucket and check under Management panel > Replication Rules and verify the S3 bucket replication region.
...
Ensure RDS read replica is set If DR in enabled (In case of DR enabled)
...
Go to the Region where Disaster recovery (DR) is enabled, and check & verify the RDS replica status. RDS name should be as per the cluster name.
...
Select DB > Connectivity & Security:
...
Check Target group is healthy
...
Go to the DR region, then select VPC. VPC will be created by cluster name.
Verify the S3 bucket, it should be created with the cluster name.
...
Check Secret Manager and RDS is replicated in DR (Applicable only when DR is opted)
...
Secret Manager Screenshot:
...
RDS:
...
Verify user can login to Kyvos Manager portal
...
Verify desired number of BI server and QE are available on Kyvos Manager portal
On Kyvos Manager Portal, there is a cluster dashboard that contains the instance’s IP along with its Role (BI Server, Query Engines, Kyvos Manager, Web Server).
Check instances and number of BI and QE services along with its role & all services should be healthy (green)
Ensure license has been uploaded and verified from both Kyvos Manager and Kyvos UI
In the license, the allowed number of BI Servers and Query engines can be verified.
License verification from Kyvos Manager: Managing Kyvos License.
Verify user can login to Kyvos Portal
After successfully cluster creation login on Kyvos Portal
Verify completed jobs on Activity Monitor on Kyvos Portal (With Support team)
All activities of the Kyvos portal can be monitored from the Kyvos Portal.
Login on Kyvos Portal > Monitor >
...
Completed processes.
Verify in KMS keys "DevOps AWS console user (Pramod, Humera, Vikas)" are added
In the current CloudFormation Template, the member who creates the cluster only can start the cluster. Other team members can only stop the cluster. To provide the access to team member then their AWS login username should be added to the KMS key.
Go to the AWS KMS (Key Management Service) console at Primary Region, then select customer-managed keys and select cluster KMS key and its key policy.
Go to the AWS KMS console at Disaster Recovery Region, then select customer-managed keys and select cluster KMS key and verify its key policy.
Verify Pem keys and EMR certificate are saved in central S3 bucket
The PEM key and EMR certificate are used in the cluster. The PEM keys are used to login on Bastion host and Kyvos Manager host. These keys are used by DevOps & Support team members. The DevOps team is responsible for saving the keys.
Following S3 bucket used to save the keys & EMR certificate
Example: S3: kyvos-devops/<region-name>/customer_data/<Stack Name>Go to S3 bucket and search cluster name, verify PEM keys and EMR certificate in it.
No Error in Application logs after enabling TLS
When the cluster is deployed then application logs should be clear (without an error). To check application logs, login on BI. KM and Web server from terminal then verify the logs from following locations.
Logs file Location:
Kyvos application Logs (KM Node & WS1 Node)
Kyvos Manager logs on KM instance: /data/kyvos/installs/kyvos/jakarta/logs
Kyvos user portal logs on KM instance: /data/kyvos/app/kyvos/jakarta/logs
Kyvos Web Portal Logs on WS1 instance: /data/kyvos/app/kyvos/jakarta/webapps/kyvos/client/logs
BI BI server Logs (BI server Node)
/data/kyvos/app/kyvos/olapengine/logs
QE Logs QE Logs (QE Node)
/data/kyvos/app/kyvos/queryengine/logs
Ensure WAF is enabled
WAF helps to protect the Applications or APIs against common web exploits and bots that may affect availability, compromise security, or consume excessive resources. Web Application Firewall should be enabled for Kyvos Environment.
Go to AWS WAF & Shield console, select WAF & Shield, then select WebACLs with cluster name.
...
Pre-validation
RDS Postgres version should be 13.6
Verify it from the CloudFormation template.
...
Post-validation
Kyvos Component version should be matched as per the release version
Verify it from the Kyvos Manager and Kyvos Web portal.
Kyvos Manager Portal | Kyvos Web portal |
---|
Load Balancer Configuration and rules should be proper
...
Attaching screenshots of Load balancer configuration:
...
KM-ALB should be associated with a separate security group to provide an additional level of security.
For “Kyvos Manager ALB”, it should be associated with a separate security group and inbound rule as Protocol: TCP, Type: HTPPS, Port 443, Inbound: 103.250.170.125/32 (Impetus VLAN IP)
New KM-ALB SG: sg-088fa4b571423b5a3
...
In Kyvos Manager, under the Settings configure the SMTP using the given details.
...
After applying the changes, validate the email ID.
...
You will receive a verification link for validation. Click on it to validate
Verification link: https://127.0.0.1:9443/kyvosmanager/mailverify/noreply-alerts.365@kyvos.io
...
LDAP Integrations
Configure LDAP from Kyvos Manager UI under the Settings section and verify the same by logging in to Kyvos Manager and Kyvos Portal using Kyvos Support Team’s id and password
...
Open new excel file Under “Data” click on “From Web” Now provide the URL and search.
...
Email Validation Page:
...
https://kyvosqa.free-trial.kyvosinsights.com/kyvos/
...
In Kyvos Manager, go to Java Options Configurationand append the below parameter in Additional Java Options.
-Dmail.smtp.starttls.enable=true -Dmail.debug=true -Dmail.smtp.ssl.protocols=TLSv1.2
...
Under Under Security Configurations, update the LDAP values. Save it, apply, and then verify the same by logging in to Kyvos UI using support credentials.
...
Secret Manager Validation
Go to Secret Manager from the AWS console. Click on Retrieve secret value.
...
You will see the password is encrypted. To verify them, ping Mayuresh to decode the passwords. After conversion, validate them.
...
From the AWS console verify the EMR version, it should be 6.5 and Livy enabled.
...
EMR-Livy Configuration
Property for livy timeout livy.server.yarn.app-lookup-timeout ->1800s should be present on EMR under configuration section.
...
TLS –Certificate Validation
...