Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Processing semantic model with source as Snowflake on AWS

To process the semantic model with source as Snowflake on AWS,

...

Panel
panelIconIdatlassian-note
panelIcon:note:
bgColor#DEEBFF

Note

This requires AWS console access and Snowflake account administrators (users with the ACCOUNTADMIN role) or a role with the global CREATE INTEGRATION.

  • Execute the GRANT USAGE ON STAGE <stagename> TO ROLE <role_used_on_Kyvos_SF_Connection>; query on Snowflake with the role used in Snowflake connection in Kyvos.

  • Add the kyvos.connection.snowflake.stage = @mydb.myschema.mystage property on Snowflake connection.
    NOTE: Here, mydb is the database name, myschema is the schema name, and mystage is the stage name.

  • Update the IAM role in your bucket policy that you created while configuring a Snowflake storage integration to access Amazon S3 in the above step.

Processing semantic model with source as Snowflake on GCP

Below are the steps to create the stage before triggering any semeantic model:

  1. CREATE STORAGE INTEGRATION <storage_integration_name>
    TYPE = EXTERNAL_STAGE
    STORAGE_PROVIDER = 'GCS'
    ENABLED = TRUE
    STORAGE_ALLOWED_LOCATIONS = ('gcs://<bucket_name>')

  2. GRANT USAGE ON INTEGRATION <storage_integration_name> TO ROLE ACCOUNTADMIN;

  3. CREATE STAGE <stage_name>
    URL = 'gcs://<bucket_name>/user/engine_work/temp/'
    STORAGE_INTEGRATION = <storage_integration_name>
    FILE_FORMAT = (TYPE=<file_format_type>);                                                  

  4. GRANT USAGE ON DATABASE <DB_name> TO ROLE ACCOUNTADMIN;
    GRANT USAGE ON SCHEMA <DB_name>.<Schema_name> TO ROLE ACCOUNTADMIN;
    GRANT CREATE STAGE ON SCHEMA <DB_name>.<Schema_name> TO ROLE ACCOUNTADMIN;

  5. Add below property in Snowflake connection
    kyvos.connection.snowflake.stage = @<DB_name>.<Schema_name>.<stage_name>
    example: kyvos.connection.snowflake.stage = @automationtables.public.teststage4July

For further details about configuring an integration for Google Clous Storage, see Snowflake documentation.