Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Page properties
hiddentrue
idprops
version10.6.0.3
docRelease Notes
prodWhereScape RED

WhereScape is pleased to announce that WhereScape RED 10.56.0.0 3 is now available.

This release of RED is compatible with WhereScape 3D 9.0 versions and up.

Note
titleNote
Before upgrading, review the Important Messages when Upgrading for more information.

Table of Contents
maxLevel2

...

Log into the WhereScape Support Portal to access downloads.

New Features

...

Upgrade Process

A new scheduler upgrade wizard has been developed which streamlines the upgrade process and reduces the number of manual steps required during scheduler upgrades.
Authentication profiles are now created automatically when upgrading from a version of RED which does not include the advanced connect feature. Refer to the Upgrade on Windows guide for more information.

Installation

Metadata databases and DSN's for RED and the Azkaban Scheduler can now be created using the installation wizards, reducing the number of manual steps required during new installs. For more information refer to the metadata installation and scheduler installation guides.

Profile Maintenance

A new scheduler profile maintenance wizard has been developed with an enhanced UI. For more information refer to the Scheduler Maintenance documentation.

Increased limits

The maximum number of projects and groups can now be configured, allowing for over 1000 projects and groups in a single repository. This can be changed on the Other Options window.
Increased the character limit on FROM/WHERE clause for views to 65344 characters.

RED med.exe (RED UI)

When starting med.exe (RED UI) from a command line with all the required metadata connection elements provided, you can now provide and additional switch '--auto-connect' which will skip the interactive login screen to RED.

Added RED UI ODBC connection resilience, idle connections are tested before use and recovered if broken. Idle time before testing and test response time can be fine-tuned via user preferences. Visit the med.exe Client Command Line documentation for this and other available options.

Scheduler

RED's job plugin for Azkaban now accepts the legacy RED 9 script output protocol when executing stand-alone scripts via a scheduler job, this feature eases migrations to RED 10 by reducing script refactoring and testing.

Extensible Authentication

In this release of RED we have added a new feature enabling Extensible Authentication for Connections in RED. This feature combines connection resilience, authentication scripts and  extended RED Profile attributes to create a framework for connecting to systems which require complicated client side authentication workflows not provided directly by their respective ODBC drivers and/or tools.

This feature enables working with authentication workflows such as oAuth 2.0 and Entra ID, but also allows a way to pop-out to additional authentication UI's such as for entry of Time-based One-Time Passwords for multi-factor authentication.

This feature is enabled through the following new functionalities of RED for ODBC/Database and Extensible Source Connections:

New Advanced Connect Parameters on Connections

Two new groups under Advanced Connect Parameters have been added to Connections, all of these session-level fields are in-memory only and can be persisted to your RED Profile between sessions.

Image Added

Auth Configuration

  • Auth Configuration JSON - Arbitrary JSON storage of any required authentication attributes for this connection. 
  • Auth Script Command - When specified this command will be triggered during RED's authentication process to this connection.
  • Auth Expires After - Duration in mins after which RED will reconnect at the next opportunity.

Auth Tokens

  • Token (1,2,3) - Three new encrypted fields which can be used in connection strings using the token format $AUTHTKN_[1|2|3]$ for expansion at runtime. Display names can be adjusted via the RED Profile to suit a particular authentication type.


Scripted Authentication

Scripted Authentication can be enabled for a connection by providing a command line to run in the 'Auth Script Command' field. This command will be triggered by RED when it needs to authenticate with this connection for the first time and then again whenever the 'Auth Expires After' minutes has been exceeded.

When RED executes the 'Auth Script Command' this is the typical workflow: 

  1. RED UI
    1. Saves the current RED Profile to disk and provide access to this Profile file and the connection name requiring authentication via environment variables.
    2. Runs the 'Auth Script Command'.
  2. Authentication Script
    1. Reads the RED Profile and retrieves any required Connection details from it.
    2. Performs the required authentication workflow for the connection.
    3. Updates the RED Profile on disk with refreshed Auth Tokens and other Auth Configuration values as required. 
  3. RED UI
    1. Merges the updated RED Profile file back into memory.
    2. Completes the authentication process for the connection.
    3. Resets the internal expiry for the connection based on 'Auth Expires After' mins. 

Authentication Environment Variables for All Scripts

The Extensible Authentication feature also enables the following new environment variables in RED Scripts, both via Azkaban and RED UI:

  • WSL_[META|SRC|TGT]_AUTHCFG - contains the complete JSON structure in the 'Auth Configuration JSON' field.
  • WSL_[META|SRC|TGT]_AUTHTKN_[1|2|3] - Sets of three decrypted Token values from the 'Auth Tokens' fields.

The RED Scheduler Profile table has been updated to incorporate these new fields in order to provide these values to Azkaban jobs, these can be maintained via the Scheduler Profile Maintenance script. Scripted Authentication is not supported for Azkaban in this version. 

Other Improvements

Performance Improvements

  • This release adds new indexes to the RED Metadata to enhance metadata query performance throughout the product.
  • Improved the performance of opening object properties on large repositories.

Scheduler Improvements

Detailed Changes in RED 10.6

...

.0.0

The following changes have been implemented since 10.45.0.20

Improvements

JIRARelease Note
RED-12352Updated the wsl_scheduler_profile_maintenance script to support the new authentication fields added in 10.6.0.0
RED-
12100
12343
Authentication profiles are created automatically when upgrading from a version of RED without the Advanced Connect feature.RED-11462Jobs stuck in the running state can now be aborted in the RED UI.RED-12256On hold jobs are no longer retained when processing objects via the scheduler interactively.RED-4786The maximum number of projects and groups can now be configured, allowing for over 1000 projects and groups in a single repository.RED-5905Increased the character limit on FROM/WHERE clause for views to 65344 characters.RED-12278Added RED UI ODBC connection resilience, idle connections are tested before use and recovered if broken. Idle time before testing and test response time can be fine-tuned via user preferences.RED-12130Improved performance of object properties storage tab initialization when using a Teradata target.RED-12285The Connection field 'Database Link Name' is now available to scripts as an environment variable 'WSL_LOAD_DBLINK' so that scripts can build the appropriate source SQL statements at run-time.

...

Added Scripted Authentication support to RED UI enabling extensible authentication methods for RED ODBC, Database and Extensible Source Connections
RED-12320Improved performance of opening object properties on large repositories.
RED-12302Added support to the RED Scheduler Plugin to support the new authentication tokens and connection string expansion added in RED 10.6.0.0, additional fields have been added to redadmin.ws_scheduler_profile to securely store these tokens.
RED-12092Improved performance of the RED Metadata by adding indexes to support the common metadata join patterns throughout the product.

Fixes

JIRARelease Note
RED-12361Fixed an issue where creating deployment applications via the command line was broken in 10.5.0.0
RED-12347Fixed a 3D export to RED issue where Named Targets; SQL Server, Oracle and Teradata were unable to be resolved during deployment.
RED-12328Fixed a RED Metadata syntax issue which caused update failures during manual alterations of Index Objects in RED, affecting PostgreSQL versions 15+
RED-12322Deleting jobs via application deployment will now trigger the scheduler integration script to remove the job from Azkaban.
RED-12314The new 'execute-script' method of scheduler-util.jar is now thread safe when running in multi-threaded jobs.
RED-12309The RED feature in Azkaban to execute a kill script in case of a job being manually aborted now inherits the JRE from the parent process, avoiding the need to have java on the system path.
RED-12308Resolved a RED Scheduler Plugin issue where replacements of Extended Properties via the token format $WSL_EXP_<property_name>$ were not working
RED-12295Fixed an issue where Application Deployment of Jobs was not setting the credentials for the Scheduler REST API, causing publishing of deployed jobs to fail.

Detailed Changes in RED 10.6.0.1

The following changes have been implemented since 10.6.0.0

Improvements

JIRARelease Note
RED-12353 Added support for entry of the new Auth Tokens, introduced in RED 10.6, to the Scheduler Profile Maintenance wizard.
RED-11533RED SQL Admin query tool 'dba.exe' is now Advanced Connect aware enabling seamless authentication when launching from RED Connections that utilize Advanced Connect ODBC connection stings.

Fixes

JIRARelease Note
RED-12323Resolved an issue with Application Deployment where column names greater than 64 chars, which are also a Data Vault Hash Key column name or a HK column source were losing their HK sources associations during RED to RED deployment.
RED-12354Resolved a display issue in Project Object Maintenance wizard where objects were displaying in the wrong projects due to incorrect ordering of the project drop downs.
RED-12351Fixed an issue in the Scheduler Profile Maintenance wizard where the credentials row added for the Scheduler REST API were not able to be decrypted.

RED-12344

Fixed an issue where action script association to stand-alone procedures is lost during deployment, caused by an ordering issue in the WST files. Affected deployment applications will need to be recreated to correct the ordering.

Detailed Changes in RED 10.6.0.2

The following changes have been implemented since 10.6.0.1

Improvements

JIRARelease Note

RED-

10686New Scheduler upgrade workflow automating many of the manual steps that were required.RED-12257The WhereScape RED metadata database and DSN can be automatically created using the RED Setup Wizard.RED-12102The Scheduler metadata database can be automatically created during the Scheduler installation process.RED-12103New RedSchedulerProfileMaintenance.exe for maintaining the Schedulers authentication profiles.

12404

Added Job Success and Failure command support to the RED Scheduler Plugin.

Detailed Changes in RED 10.6.0.3

The following changes have been implemented since 10.6.0.2

Improvements

JIRARelease Note

RED-12404

Improved the RED Login workflow when using Scripted Authentication so that Metadata Connection attributes are refreshed via the returned profile, enabling the ability for the Auth. Script to override what was originally entered in the login screen.

Improved the syncing of the in-memory profile when changing the connection string in RED UI to avoid synchronization issues for Scripted Authentication.

RED-12296

Improved RED's encoding detection of 3D Exported XML files when loading from XML files generated by versions of 3D earlier than 9.0.6.0, after which 3D always encodes with UTF8.

RED-12078

Improved [PROCEDUREOWNER] token replacement so that it is standardized across all targets. From this release onwards only the target location settings of the object will be considered when expanding this token, DB ID set at the connection properties page level will be ignored. This change is particularly useful for Teradata and Oracle procedures. 

Fixes

JIRARelease Note

RED-

12293Fixed a metadata insert failure when defining Reusable Transformations in RED 10

12403

Fixed an issue with Entra ID auth on PostgreSQL where RED would crash during browse operations when any password exceeded 1024 chars.

RED-

12274

12358

Fixed an issue

deploying the default 3D entity types Dim View and Retro to RED, now these entity types are correctly mapped during deployment

introduced in RED 10.4 where running interactive linux loads would fail.

Anchor
upgradeMessages
upgradeMessages
Important Messages When Upgrading

...