Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The External Task

...

External task step Step allows you to call execute standard and custom 3rd third-party processes from within Intellicus a Kyvos Reporting Query Object. Some may be in-proc and some tasks may be sent to remote execution by appropriate bridge components.There are few This step enables the integration of external tasks, which could be in-process or remote, depending on the setup.

With this step, you can trigger external processes during the execution of a Query Object. These tasks may run on the same server (in-process) or remotely through a bridge component. Kyvos Reporting supports a variety of pre-configured external tasks. More external task types can , but additional custom external tasks can also be configured.

Pre-configured External Task Types

Here are some pre-configured external task types available within Kyvos Reporting:

Task Type

Comments

Custom MapReduce Job for Hadoop

If you have

Executes custom-written scripts

, you can use this option to execute such jobs

or jobs on Hadoop clusters. Useful for big data processing using custom MapReduce logic.

Pig Job

Jobs

Allows execution of jobs created using Pig scripts

can be executed using this option

. Pig is a high-level platform for creating MapReduce programs used with Hadoop.

Custom Row Processor

Enables the transformation of data using custom logic packaged in JAR files. You can create your own logic to

transform your data using JAR files and provide it here

process data in a flexible way.

Hive Job

Hive jobs

Executes Hive queries, which are typically used for data analysis in large-scale datasets stored in Hadoop. Results can be retrieved for further analysis in the Query Object.

Usage and Flexibility

  • Custom Integration: You can integrate your own third-party tools and scripts to process data in various ways, whether it’s through Hadoop, Pig, or custom JAR-based logic.

  • Remote Execution: Some tasks can be executed remotely,

...

  • enhancing the scalability and flexibility of your processes.