...
Download the emr_spot.json file from the AWS Installation Files folder.
Log in to your AWS CloudFormation Console.
From the top-right, click Create Stack > With new resources.
Click Upload a template file and select the downloaded emr-spot.json file.
Click Next.
Here, enter the details as:
...
Click Next.
Mention Tag if needed.
Click Next.
Click Create Stack.
Now, navigate to the Kyvos Manager and configure the private IP address of the master node of the EMR on the EMR Configuration page.
Enter master IP of the EMR in EMR Master Node IP/Host Name field.
Click outside the textbox. The system automatically populates the EMR configuration.
Select Sync Configuration and click Apply.
Submit build process request to start EMR on demand.
Panel | ||||||
---|---|---|---|---|---|---|
| ||||||
Note The number of nodes and types will change as per the use cases. In the Kyvos test labs, we used 3 task groups (r5.2xlarge, r4.2xlarge, r3.2xlarge) of 10 SPOT nodes in each task group while testing various cubessemantic models. |
Manually Configuring Spot instances for EMR
...