Versions Compared

Old Version 6

changes.mady.by.user Morgan Mackeson-Ellis

Saved on

compared with

New Version Current

changes.mady.by.user Morgan Mackeson-Ellis

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This is a guide to installing the WhereScape Enablement Pack for Snowflake for WhereScape RED


Table of Contents
maxLevel2
minLevel2


Include Page
Prerequisites For PostgreSQL Metadata -WIP
Prerequisites For PostgreSQL Metadata -WIP

Prerequisites For Snowflake

Before you begin the following prerequisites must be met:

  • Create Database and ODBC DSN  :
  • Software Installations
  • Python 3.8 or higher (Tested with 3.8-3.11)
    • Select "Add Python 3.8 to PATH" from the installation Window
    • Pip Manager Install with the command: python -m pip install --upgrade pip
Note
Some of the libraries might be deprecated in the newer versions of Python (Python 3.12 and higher) 


Include Page
Install Guides-Common
Install Guides-Common


Post Install Steps - Optional

If you used the script 'Setup_Enablement_Pack.ps1' then the following optional post-install steps are available

Configure Connections

There were Three connections added that will optionally require your attention:

  1. Connection: 'Snowflake' - This connection was setup as per parameters provided in the installation script 1
    1. open it's properties and check extended properties tab, set it up for SNOWSQL_ACCOUNT and SNOWSQL_WAREHOUSE
  2. Connection: 'Database Source System' - this connection was setup as an example source connection,
    • open it's properties and set it up for a source DB in your environment
    • or you can remove it if not required
  3. Regenerate Windows Action Scripts for STAGE_DATE_SF and DIM_DATE_SF and start the job Initialize Date Dimension for Snowflake
  4. Start Job Initialize Snowsql for Scheduler Account

Enable Script Launcher Toolbar

Several stand-alone scripts provide some features such as "Ranged Loading", these scripts have been added to the Script Launcher menu but you will need to enable the menu toolbar item to see them.
To enable the Script Launcher menu in RED, select View>Toolbars>Script Launcher

Source Enablement Pack Support

Source Pack Name

Supported By Snowflake

Supported Features

Prerequisites

Amazon S3

Yes

Bulk load to Snowflake

For Powershell Load :
Install-Module -Name AWSPowerShell

Azure DataLake Storage Gen2

Yes

Bulk load to Snowflake

Generate and add SAS token to Azure DataLake Storage Gen2 connection properties:
{+}https://docs.snowflake.com/en/user-guide/data-load-azure-config.html#option-2-generating-a-sas-token+

Google Cloud Storage

Yes

Bulk load to Snowflake

1.Create Storage Integration  (Snowflake)
CREATE OR REPLACE STORAGE INTEGRATION <STORAGE_INTEGRATION_NAME>  TYPE = EXTERNAL_STAGE  STORAGE_PROVIDER = GCS  ENABLED = TRUE  STORAGE_ALLOWED_LOCATIONS = ('<BUCKET_PATH>'); 
2.Create Staging Area (Snowflake)
USE DATABASE <DATABASE_NAME>;  CREATE OR REPLACE STAGE <STAGE_NAME>  url = '<BUCKET_PATH>'  storage_integration = <STORAGE_INTEGRATION_NAME> 
3.Get Storage Integration Desc (Snowflake)
DESC STORAGE INTEGRATION <STORAGE_INTEGRATION_NAME> 
4.Copy STORAGE_GCP_SERVICE_ACCOUNT and create  IAM on Google Cloud Console with following permissions 
storage.buckets.get storage.objects.createstorage.objects.delete storage.objects.get storage.objects.list
5.Add extended properties to Google Cloud Storage Connection in RED
GCS_STORAGE_INTEGRATIONGCS_STAGE_AREA_NAME

Google Drive

Yes

Downloads file From Google Drive and uploads to Snowflake Table

None

 

Include Page
Troubleshooting and Tips - RED10
Troubleshooting and Tips - RED10