...
Download the emr_spot.json file from the AWS Installation Files folder folder.
Log in to your AWS CloudFormation Console.
From the top-right, click Create Stack > With new resources.
Click Upload a template file and select the downloaded emr-spot.json file.
Click Next.
Here, enter the details as:
...
Click Next.
Mention Tag if needed.
Click Next.
Click Create Stack.
Now, navigate to the Kyvos Manager and configure the private IP address of the master node of the EMR on the EMR Configuration page.
Enter master IP of the EMR in EMR Master Node IP/Host Name field.
Click outside the textbox. The system automatically populates the EMR configuration.
Select Sync Configuration and click Apply.
Submit build request to start EMR on demand.
| Panel | ||||||
|---|---|---|---|---|---|---|
| ||||||
Note The number of nodes and types will change as per the use cases. In the Kyvos test labs, we used 3 task groups (r5.2xlarge, r4.2xlarge, r3.2xlarge) of 10 SPOT nodes in each task group while testing various cubes. |
Manually Configuring Spot instances for EMR
...
For this, perform the following steps.
| Panel | ||||||
|---|---|---|---|---|---|---|
| ||||||
The number of nodes and types will change as per the use cases. |
Example for: 35 nodes
Click the Edit button in Cluster Scaling Policy.
...