Versions Compared

Old Version 8

changes.mady.by.user Morgan Mackeson-Ellis

Saved on

compared with

New Version Current

changes.mady.by.user eric revollo

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

If there are important updates to the Azkaban metadata these will be indicated in the important upgrade messages that follow. Refer to the Upgrading Azkaban section of the RED User Guide for more details.

Important Messages when upgrading to 10.3.0.

...

1

Cumulative
Info
titleNote

Upgrades are

Therefore cumulative; therefore you should read all upgrade messages for each version between your current RED version and this version of RED.

Upgrading RED

Version 10.3.0.

...

1

  • There are no important messages for upgrading RED to this release, but please consider the cumulative upgrade messages below when upgrading.

...

  • All ODBC, Database, Extensible Source Connection and Scheduler Configuration credentials have moved to the RED Profile, therefore each user of RED should generate their own local profile file (see the user guide for details) to continue using RED.
  • For new installs, from RED 10.2.+, you will find the wsl_scheduler_profile_maintenance host host script under your Host Script's in your RED metadata repository (see the user guide for details). For upgraded repositories you will need to load this script into RED manually from <RED_Installation_Directory>\Administrator\Scripts\wsl_scheduler_profile_maintenance.ps1
  • All Azkaban components require upgrading and the encrypted Scheduler profile records added to redadmin.ws_scheduler_profile (see the user guide for details) in order for jobs to run.
  • Post upgrade it is encouraged to remove all credentials from the metadata since these should now reside in the in-memory session level credentials only. Run the following update on the metadata to achieve this: 
    Code Block
    languagesql
    titleRemove credentials after upgrade
    -- Remove credentials from Database, ODBC and Extensible Source connections
UPDATE red.ws_dbc_connect
SET dc_extract_userid='', dc_extract_pwd='', dc_admin_userid='', dc_admin_pwd=''
WHERE dc_type IN ('D','O','Z');

-- Remove credentials from Scheduler Configuration
UPDATE red.ws_wrk_external_scheduler
SET wes_dashboard_userid='', wes_dashboard_pwd='', wes_restapi_userid='', wes_restapi_pwd='';

...

Upgrading Azkaban is currently a manual process, please refer to the RED User guide for detailed upgrade instructions.

Version 10.3.0.

...

1

  • RED 10.3 improves the metadata connection resilience in both the Azkaban Web Server component and RED Job Plugin. Each of the Azkaban metadata, Azkaban Web Server and Azkaban Executors will need to be upgraded to take advantage of these features.

...

Change history for Azkaban components requiring upgrades (changes are cumulative):

  • 10.3.0.01: Azkaban/RED metadata connection resilience improvements.  Component Component upgrades.
  • 10.2.0.0: New required fields for azkaban.local.properties and installer resposne.xml for Advanced Connect. Stand-alone script execution enhancements.
  • 10.1.0.1: Log4j components upgraded to log4j2 to resolve logging issues.
  • 10.1.0.0: Improvements when canceling running jobs. Component upgrades.
  • 10.0.1.0: Added procedure support and long host names fix.
  • 10.0.0.0: First release.

...

Change history for integration  scripts requiring manual upgrade (changes are cumulative), upgrades are optional unless marked as required:

  • 10.3.0.01: No changes
  • 10.2.0.0: 
    • wsl_scheduler_publish - Required upgrade - Advanced Connect feature added.
    • wsl_scheduler_lookup - Added version header and removed unused parameters.
    • wsl_scheduler_dashboard - Added version header and removed unused parameters. 
    • wsl_scheduelrscheduler_profile_maintenance - New script for maintaining the scheduler profile.
  • 10.0.0.3:  wsl_scheduler_publish - Support for republishing when existing job not found. Improved logging.
  • 10.0.0.2:  wsl_scheduler_publish - Added support for disabled tasks.
  • 10.0.0.0: First release.