Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

#

Enablement Pack Setup Scripts

Script Purpose

Run as Admin

Intended Application

1

Setup_Enablement_Pack.ps1

Installs or updates source enablement pack in existing RED Metadata Repository for the target database
Installs Python scripts and UI Config Files for browsing files from Windows, Amazon S3, Azure Datalake Storage gen2, Google Cloud Storage

Yes

New and Existing installations

2

install_WslPython_Modules.bat

Installs or updates WslPython Modules and required Python libraries on this machine
Installs required Python packages for Amazon S3, Azure Datalake Storage gen2, and Google Cloud Storage mentioned in the Prerequisites section

Yes

New and Existing installations

The PowerShell script above provides some help at the command line, this can be output by passing the "-help" parameter to the script.

...

Source Enablement Pack Installation

Installation Script to an existing target database repository
Run Windows Powershell as Administrator 

...

  1. File Parser Browse Script - In RED ensure the File Parser Browse Script was installed, under the Host Scripts object tree node check for the object named: 'Browse_File_Parser'                                                                         
  2. UI Configurations - In RED check the Menu: 'Tools->UI Configurations->Maintain UI Configurations' for the appropriate UI Configurations*.

...

Amazon S3 Connection Setup

Image Modified

Azure Data Lake  Storage Gen2 Connection Setup

Image Modified

REST API Connection Setup

Image Modified
GET Method (Open API)

Image Modified
POST Method (With Authentication)

Salesforce Connection Setup

Image Modified

 API Method
Image Modified
SOQL (Salesforce Object Query) Method

Note

NOTE: For more information on Security Token. Please refer to the official Salesforce documentation here

Google Cloud Connection Setup

Image ModifiedNOTE:

Note
For Google Cloud, Install and configure Google Cloud SDK

Cloud Browser


  1. Select and click Add to copy files to staging area.
  2. Click Back to navigate to previous directory
  3. Click OK to download files for parsing.

...

  1. Login to RED
  2. Check Host Script - Browse_File_Parser.py in the objects list.                                                                                  
  3. Check UI Configurations in Menu, Tools → UI Configurations → Maintain UI Configurations
  4. Create a new connection in RED
  5. Select properties as shown in below  screenshot  

Image Modified

Browse Parser

Choose parser as per file type
Image RemovedImage Added
If the files are of same type and parsing options are same, check highlighted box to save same options.
Image RemovedImage Added

Parser for JSON and XML Files

The JSON parser GUI's main pane, The file name is highlighted, and the JSON tree structure is shown below it.
Hovering the cursor over any widget or element in the GUI will display information about that widget or element in the bottom help box.
Image Modified
Select any node in the JSON tree and press the Add button at the bottom to create a new entity. On the right side of the window, a new pane will appear. The name of the new entity will be "Entity 0" by default. If the selected node is a leaf node (key value pair), this new entity will include only its key; if the selected node is an object or array, this new entity will include all of its children. The data type of the node is highlighted in the figure below.
Image Modified
Select the entity and use the Remove button to remove any specific node. To remove the entire entity object, choose the primary node (for example, Entity_0) and press the "the Remove" button in the same way. Note:

Note
Holding the "Ctrl" key on the keyboard while clicking on different nodes allows the user to select multiple nodes.



Image Modified
To add a new node from a JSON tree to an entity that has already been created. Select the node in the JSON tree to which the node should be added (Example: Entity_0), select one or more nodes, and click Add to add the selected node to the selected entity.
Image Modified
To edit the name of Entity, Select the entity and press the "Edit" button to change the name. This will open a window with a text box where you may type in the new name for that object and then click Ok
Image Modified
In the selected entities pane, nodes in entities with more than 64 characters are colored "red." In WhereScape RED, the names of these "red" colored nodes are trimmed.
Image Modified 
To add a complete file for profiling select the below option from the Tools Menu
Image Modified 
After selecting all the entities and files options,progress of the profiling will appear with the progress bar and can be canceled at any point.
Image Modified 
The working XML parser is similar to JSON parser explained above.

...

Azure-storage module not found error

Image Modified

 For Error: azure-storage module not found error while browsing Azure Data Lake File Browser Connection. 
Follow the below steps:1)

  1. pip uninstall azure-storage -y

...

  1. pip uninstall azure-storage-file-datalake -y

...

  1. pip uninstall azure-common azure-core azure-nspkg -y

...

  1. pip uninstall azure-storage-blob -y

...

  1. Run uninstall_WslPython_Modules.bat

...

  1. Run install_WslPython_Modules.bat