Custom Step
- sunny.gupta
The External Task Step allows you to execute standard and custom third-party processes within a Kyvos Reporting Query Object. This step enables the integration of external tasks, which could be in-process or remote, depending on the setup.
With this step, you can trigger external processes during the execution of a Query Object. These tasks may run on the same server (in-process) or remotely through a bridge component. Kyvos Reporting supports a variety of pre-configured external tasks, but additional custom external tasks can also be configured.
Pre-configured External Task Types
Here are some pre-configured external task types available within Kyvos Reporting:
Task Type | Comments |
|---|---|
Custom MapReduce Job for Hadoop | Executes custom-written scripts or jobs on Hadoop clusters. Useful for big data processing using custom MapReduce logic. |
Pig Job | Allows execution of jobs created using Pig scripts. Pig is a high-level platform for creating MapReduce programs used with Hadoop. |
Custom Row Processor | Enables the transformation of data using custom logic packaged in JAR files. You can create your own logic to process data in a flexible way. |
Hive Job | Executes Hive queries, which are typically used for data analysis in large-scale datasets stored in Hadoop. Results can be retrieved for further analysis in the Query Object. |
Usage and Flexibility
Custom Integration: You can integrate your own third-party tools and scripts to process data in various ways, whether it’s through Hadoop, Pig, or custom JAR-based logic.
Remote Execution: Some tasks can be executed remotely, enhancing the scalability and flexibility of your processes.
Related content
Copyright Kyvos, Inc. All rights reserved.