This chapter covers the saving and reloading of metadata repository objects. The backup section describes the RED UI and equivalent command line methods for backing up the metadata repository.  The restore section covers the metadata restoration of those backups, either through the RED UI or via the command line. 

PostgreSQL provides many methods and tools to backup and restore databases, the backup and restore tools and methods described in this user guide are designed to work together.

When backing up RED and/or Azkaban Metadata it is important to consider the following points

Coordinating backups

If you wish to create a complete snapshot of RED and Azkaban together then the backups should be coordinated together as your Azkaban database may be different to your RED database.

  • RED Schemas:
    • red - the RED Metadata 
    • redadmin - the Scheduler Profile
  • Azkaban Schemas: 
    • white

Restoring Backups

If restoring over existing database schemas using the backup format RED creates then be sure to include the --clean switch when restoring so that the objects are dropped first, this prevents duplication of rows in your metadata. 

When restoring Azkaban from a backup this should be done with the matching backup of RED otherwise there will be synchronization issues with the scheduled jobs.

When restoring RED for the purpose of replicating an environment it is recommended to restore RED via the RED UI option, then install a new Azkaban scheduler (with new metadata) and publish all the jobs from RED to the new scheduler.

When restoring Azkaban from a backup ensure you have stopped all Azkaban services prior to running the restore. 

  • No labels