Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Applies to: (tick) Kyvos Enterprise  (tick) Kyvos Cloud (SaaS on AWS) (tick) Kyvos AWS Marketplace

...

Panel
panelIconIdatlassian-note
panelIcon:note:
bgColor#DEEBFF

Note

  • From Kyvos 2023.3 onwards, you can cancel Drop partition jobs. 

  • From Kyvos Manager, you can set the duration (in hours) to limit the semantic model process time using the BUILD_TIME_THRESHOLD (OlapEngine   property). Once the semantic model process limit is reached, the process will fail. If you resume the semantic model process, it will use the same duration that you set during the initial semantic model process. 

There are two options for scheduling the different build process types. See Semantic model process types. Click the i icon next to the job type list to get a description of each process type. 

...

Aura tab collection
paramsJTdCJTIyZ2VuZXJhbCUyMiUzQSU3QiUyMnRhYlNwYWNpbmclMjIlM0EwJTJDJTIydGFiV2lkdGglMjIlM0ExMDAlMkMlMjJ0YWJIZWlnaHQlMjIlM0E1MCUyQyUyMmRpcmVjdGlvbiUyMiUzQSUyMmhvcml6b250YWwlMjIlN0QlMkMlMjJjb250ZW50JTIyJTNBJTdCJTIyYmFja2dyb3VuZENvbG9yJTIyJTNBJTdCJTIyY29sb3IlMjIlM0ElMjIlMjNmZmYlMjIlN0QlMkMlMjJib3JkZXIlMjIlM0ElN0IlMjJzdHlsZSUyMiUzQSUyMnNvbGlkJTIyJTJDJTIyd2lkdGglMjIlM0ExJTJDJTIydG9wJTIyJTNBdHJ1ZSUyQyUyMmJvdHRvbSUyMiUzQXRydWUlMkMlMjJsZWZ0JTIyJTNBdHJ1ZSUyQyUyMnJpZ2h0JTIyJTNBdHJ1ZSUyQyUyMmNvbG9yJTIyJTNBJTdCJTIybGlnaHQlMjIlM0ElMjIlMjNjY2NlY2YlMjIlN0QlN0QlMkMlMjJwYWRkaW5nJTIyJTNBJTdCJTIydG9wJTIyJTNBMTAlMkMlMjJyaWdodCUyMiUzQTEwJTJDJTIyYm90dG9tJTIyJTNBMTAlMkMlMjJsZWZ0JTIyJTNBMTAlN0QlN0QlMkMlMjJhY3RpdmUlMjIlM0ElN0IlMjJiYWNrZ3JvdW5kQ29sb3IlMjIlM0ElN0IlMjJjb2xvciUyMiUzQSU3QiUyMmxpZ2h0JTIyJTNBJTIyJTIzZjU4MjI3JTIyJTdEJTdEJTJDJTIydGV4dCUyMiUzQSU3QiUyMmZvbnRTaXplJTIyJTNBMTYlMkMlMjJjb2xvciUyMiUzQSU3QiUyMmxpZ2h0JTIyJTNBJTIyJTIzMDAwMDAwJTIyJTdEJTJDJTIydGV4dEFsaWduJTIyJTNBJTIybGVmdCUyMiUyQyUyMmZvbnRXZWlnaHQlMjIlM0ElMjJib2xkJTIyJTdEJTdEJTJDJTIyaG92ZXIlMjIlM0ElN0IlMjJiYWNrZ3JvdW5kQ29sb3IlMjIlM0ElN0IlMjJjb2xvciUyMiUzQSUyMiUyM2RmZTFlNiUyMiU3RCUyQyUyMnRleHQlMjIlM0ElN0IlMjJmb250U2l6ZSUyMiUzQTE4JTJDJTIyY29sb3IlMjIlM0ElMjIlMjM1ZTZjODQlMjIlMkMlMjJ0ZXh0QWxpZ24lMjIlM0ElMjJsZWZ0JTIyJTJDJTIyZm9udFdlaWdodCUyMiUzQSUyMmxpZ2h0ZXIlMjIlN0QlN0QlMkMlMjJpbmFjdGl2ZSUyMiUzQSU3QiUyMmJhY2tncm91bmRDb2xvciUyMiUzQSU3QiUyMmNvbG9yJTIyJTNBJTIyJTIzZjRmNWY3JTIyJTdEJTJDJTIydGV4dCUyMiUzQSU3QiUyMmZvbnRTaXplJTIyJTNBMTYlMkMlMjJjb2xvciUyMiUzQSUyMiUyMzVlNmM4NCUyMiUyQyUyMnRleHRBbGlnbiUyMiUzQSUyMmxlZnQlMjIlMkMlMjJmb250V2VpZ2h0JTIyJTNBJTIybGlnaHRlciUyMiU3RCUyQyUyMmJvcmRlciUyMiUzQSU3QiUyMnRvcCUyMiUzQXRydWUlMkMlMjJsZWZ0JTIyJTNBdHJ1ZSUyQyUyMnJpZ2h0JTIyJTNBdHJ1ZSUyQyUyMmJvdHRvbSUyMiUzQXRydWUlMkMlMjJ3aWR0aCUyMiUzQTElMkMlMjJzdHlsZSUyMiUzQSUyMnNvbGlkJTIyJTJDJTIyY29sb3IlMjIlM0ElN0IlMjJsaWdodCUyMiUzQSUyMiUyM2NjY2VjZiUyMiU3RCU3RCU3RCU3RA==
Aura tab
summaryProcess Full Data
paramsJTdCJTIydGl0bGUlMjIlM0ElMjJQcm9jZXNzJTIwRnVsbCUyMERhdGElMjIlN0Q=
  1. From the Toolbox, choose Semantic Model.

  2. Select a cube semantic model from the list and click Process

  3. From the top right of the window, click Schedule Process.

  4. From the Job Type list, select the Full Build Process option.

  5. Select the Build Process connection that you want to use. In case there are multiple build process connections in the underlying registered files in the semantic model, semantic model validation will be triggered on the default Hadoop connection.

  6. You can review and alter the design using recommendations.

  7. If the last build process failed, you can resume from the last failure state. Click Resume to confirm. Use the Build Source Datasets options to specify whether to materialize datasets with every build process or not.

  8. Depending upon the type of Aggregation Strategy selected in the cube semantic model design, you can add additional query patterns or analyze query patterns using the corresponding links. 

    1. Optionally, click filter queries to select the queries to be used for the aggregation strategy.

    2. The system will automatically generate aggregates definitions based on the latest data profiles, all available historical queries, and additional query patterns.

  9. Choose to run once, now, or set up a recurring schedule. With each option, you can also view or change the properties currently in use.

    • If you choose Once, select a date, time, and time zone.

    • To set up a recurring buildprocess, enter the start and end times, the frequency, date, hours, minutes, and time zone.
      Specify whether to build process once per day or repeat. Kyvos picks the time zone from where the report server is running, as the default time zone.

  10. Click Schedule to start the buildprocess.

Aura tab
summaryIncremental Process
paramsJTdCJTIydGl0bGUlMjIlM0ElMjJJbmNyZW1lbnRhbCUyMFByb2Nlc3MlMjAlMjIlN0Q=
  1. From the Toolbox, choose Semantic Model.

  2. Select a cube semantic model from the list and click Process.

  3. From the top right of the window, click Schedule BuildProcess.

  4. From the Job Type list, select the Incremental BuildProcess option.

  5. Select the Build connection that you want to use. In case there are there are multiple build process connections in the underlying datasets in the semantic model, semantic model validation will be triggered on the default Hadoop connection.

  6. From the Process list, select any of the following:

    1. All Newer Data: Detects and processes all the new data in the files used in semantic model design.

    2. Only Fact Adjustment: Detects and processes only adjustable measures in fact files used in semantic model design. In this case, the old data is not overridden, and the adjustment data can be incrementally loaded in the cube semantic model without touching any previous data. The adjustments will be made at the lowest granularity of the measure data. Adjustment build process can be completedquickly and there can be multiple adjustments in a day. The adjustment details are also displayed in the job summary.

  7. Use the Replace Partition option to update the already processed data. This option drops out old data and adds current data - keeping the partition size constant. See Replace Partitions.

  8. Depending upon the type of Aggregation Strategy selected in the cube semantic model design, you can select any of the following:

    1. Generate additional aggregates, keeping the existing ones (if any): Additional aggregates definition recommendation will be taken keeping existing aggregates as it is.

    2. Use existing aggregates definition: No new aggregates definition recommendation will be taken, aggregates will be created using the existing definition only.

  9. Add additional query patterns or analyze query patterns using the corresponding links. 

  10. Optionally, click filter queries to select the queries to be used for the aggregation strategy.

  11. Choose to run once, now, or set up a recurring schedule. With each option, you can also view or change the properties currently in use.

    • If you choose Once, select a date, time, and time zone.

    • To set up a recurring buildprocess, enter the start and end times, the frequency, date, hours, minutes, and time zone.
      Specify whether to build process once per day or repeat. Kyvos picks the time zone from where the report server is running, as the default time zone.

  12. Click Schedule to start the buildprocess.

Aura tab
summaryProcess Test Data
paramsJTdCJTIydGl0bGUlMjIlM0ElMjJQcm9jZXNzJTIwVGVzdCUyMERhdGElMjIlN0Q=
  1. From the Toolbox, choose Semantic Model.

  2. Select a cube semantic model from the list and click Process

  3. From the top right of the window, click Schedule BuildProcess.

  4. From the Job Type list, select the Test BuildProcess option.

  5. Select the Build connection that you want to use. In case there are there are multiple build process connections in the underlying registered files in the semantic model, semantic model validation will be triggered on the default Hadoop connection.

  6. From Input Data, you can specify the number of last fact data partitions or the number of records to be processed for the test buildprocess.

    Use the Build Source Datasets options to specify whether to materialize datasets with every build process or not.

  7. Depending upon the type of Aggregation Strategy selected  in the cube semantic model design, you can select any of the following:

    1. Generate minimal aggregates: Semantic model will be processed with minimal aggregation strategy (lowest level materialization only). Use this option to compute values for only the lowest levels in the hierarchy.

    2. Generate fresh aggregates: Fresh aggregates definition recommendation will be taken and existing aggregates will be deleted (if any).

    3. Use existing aggregates definition: No new aggregates definition recommendation will be taken, aggregates will be created using the existing definition only.

  8. Add additional query patterns or analyze query patterns using the corresponding links. 

  9. Optionally, click filter queries to select the queries to be used for the aggregation strategy.
    NOTE: This build process will overwrite existing semantic model data (if any).

  10. Choose to run once, now, or set up a recurring schedule. With each option, you can also view or change the properties currently in use.

    • If you choose Once, select a date, time, and time zone.

    • To set up a recurring buildprocess, enter the start and end times, the frequency, date, hours, minutes, and time zone.
      Specify whether to build process once per day or repeat. Kyvos picks the time zone from where the report server is running, as the default time zone.

  11. Click Schedule to start the process.

Aura tab
summaryUpdate Aggregates
paramsJTdCJTIydGl0bGUlMjIlM0ElMjJVcGRhdGUlMjBBZ2dyZWdhdGVzJTIyJTdE
  1. From the Toolbox, choose Semantic Model.

  2. Select a cube semantic model from the list and click Process

  3. From the top right of the window, click Schedule BuildProcess.

  4. From the Job Type list, select the Upgrade Aggregates option.

  5. Select the Build connection that you want to use. In case there are multiple build process connections in the underlying registered files in the semantic model, semantic model validation will be triggered on the default Hadoop connection.

  6. You can review and alter the design using recommendations.

  7. Select partitions to update aggregates. 

  8. Depending upon the type of Aggregation Strategy selected in the semantic model design, you can select any of the following:

    1. Generate additional aggregates, keeping the existing ones (if any): Additional aggregates definition recommendation will be taken keeping existing aggregates as it is.

    2. Use existing aggregates definition: No new aggregates definition recommendation will be taken, aggregates will be created using the existing definition only.

  9. Add additional query patterns or analyze query patterns using the corresponding links. 

  10. Optionally, click filter queries to select the queries to be used for the aggregation strategy.
    NOTE: This build process will overwrite existing cube semantic model data (if any).

  11. Choose to run once, now, or set up a recurring schedule. With each option, you can also view or change the properties currently in use.

    • If you choose Once, select a date, time, and time zone.

    • To set up a recurring buildprocess, enter the start and end times, the frequency, date, hours, minutes, and time zone.
      Specify whether to build process once per day or repeat. Kyvos picks the time zone from where the report server is running, as the default time zone.

  12. Click Schedule to start the buildprocess.

Anchor
AddJob
AddJob

Other job types

To schedule other job types, click the ... menu on the Process tab and choose Add other jobs option.

...

When you choose Full or Full Test data process, you can specify to process the source databases if modified (if changes have occurred) or build process always. Depending on the job type you select, you can also define whether to process once per day or repeat. You can also view the properties currently in use or change them.

...