IBM DS8000 Transparent Cloud Tiering: DS8000 Release 9.3

IBM DS8000 Transparent Cloud Tiering: DS8000 Release 9.3

by Alexander Warmuth, Nielson “Nino” de Carvalho
Released August 2023
Publisher(s): IBM Redbooks
ISBN: 9780738460918

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication gives a broad understanding of storage clouds and the initial functions that were introduced for mainframe data to be transferred to cloud storage
.
IBM Data Facility Storage Management Subsystem (DFSMS) and the IBM DS8000® added functions to provide elements of serverless data movement, and for IBM z/OS® to communicate with a storage cloud. The function is known as Transparent Cloud Tiering (TCT) and is composed of the following key elements:


  • A gateway in the DS8000, which allows the movement of data to and from Object Storage by using a network connection.
  • DFSMShsm enhancements to support Migrate and Recall functions to and from the Object Storage. Other commands were enhanced to monitor and report on the new functions.
  • DFSMShsm uses the Web Enablement toolkit for z/OS to create and access the metadata for specific clouds, containers, and objects.
  • DFSMSdss enhancements to provide some basic backup and restore functions to and from the cloud. The IBM TS7700 can also be set up to act as though it is cloud storage from the DS8000 perspective.

This IBM Redbooks publication is divided into the following parts:

  • Part 1 provides you with an introduction to clouds. It provides basic knowledge and terminology.
  • Part 2 shows you how we set up the TCT in a controlled laboratory and how the new functions work. We provide points to consider to help you set up your storage cloud, including network connectivity, and integrate it into your operational environment.
  • Part 3 shows you how we used the new functions to communicate with the cloud and to send data to it and retrieve data from it..

This edition applies to DS8900F Release 9.3 and covers more recent features of TCT such as multi-cloud connections, along with extra advice for high availability cloud connectivity and DFSMShsm improvements.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. Authors
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Summary of changes
    1. August 2023
  5. Part 1 Introducing Transparent Cloud Tiering and cloud
  6. Chapter 1. Storage tiering history and the value of Transparent Cloud Tiering
    1. 1.1 Storage tiers
    2. 1.2 Hardware layers overview
    3. 1.3 Software layers
    4. 1.4 DFSMShsm behavior without TCT
    5. 1.5 Introducing Transparent Cloud Tiering
  7. Chapter 2. Cloud overview
    1. 2.1 What defines a cloud in the context of TCT
    2. 2.2 Compute cloud versus a storage cloud
    3. 2.3 Types of storage
    4. 2.4 Cloud storage delivery models
    5. 2.5 Object storage hierarchy
      1. 2.5.1 Storage cloud hierarchy
      2. 2.5.2 Metadata
  8. Chapter 3. Transparent Cloud Tiering
    1. 3.1 Transparent Cloud Tiering overview
    2. 3.2 Transparent Cloud Tiering data flow
      1. 3.2.1 DS8000 cloud connection
      2. 3.2.2 DFSMS cloud connection
    3. 3.3 Storing and retrieving data by using DFSMS
    4. 3.4 Transparent Cloud Tiering and disaster recovery
    5. 3.5 Transparent Cloud Tiering and DS8000 Copy Services
      1. 3.5.1 IBM FlashCopy
      2. 3.5.2 Metro Mirror
      3. 3.5.3 Metro Mirror with HyperSwap
      4. 3.5.4 Global Mirror
      5. 3.5.5 Multi-site data replication
    6. 3.6 DS8900F multi-cloud support
    7. 3.7 Transparent Cloud Tiering encryption
    8. 3.8 Transparent Cloud Tiering secure data transfer with TS7700
    9. 3.9 Transparent Cloud Tiering compression with TS7700
    10. 3.10 Selecting data to store in a cloud
  9. Part 2 Setting up Transparent Cloud Tiering
  10. Chapter 4. Requirements
    1. 4.1 Ethernet connections on DS8000
    2. 4.2 z/OS level
    3. 4.3 IBM zSystems host system hardware requirements
      1. 4.3.1 The CP Assist for Cryptographic Function feature
      2. 4.3.2 IBM Crypto Express feature
    4. 4.4 DS8000 release level
    5. 4.5 TS7700 release level and features
    6. 4.6 Authentication information
      1. 4.6.1 Endpoint
      2. 4.6.2 Cloud credentials
      3. 4.6.3 Certificates (if using SSL/TLS)
    7. 4.7 SSL/TLS considerations
  11. Chapter 5. Connectivity and network setup for Transparent Cloud Tiering
    1. 5.1 Networking communication overview
    2. 5.2 DS8000 to object storage connection
      1. 5.2.1 Connecting to a TS7700
      2. 5.2.2 Connecting to a local cloud object store
      3. 5.2.3 Connecting to a public cloud object storage service
  12. Chapter 6. Configuring the IBM DS8000 for Transparent Cloud Tiering
    1. 6.1 Configuring the IBM DS8000 for TCT
      1. 6.1.1 Ethernet configuration
      2. 6.1.2 Cloud configuration
    2. 6.2 Maintaining the cloud server configuration
      1. 6.2.1 Listing a cloud server configuration
      2. 6.2.2 Updating or removing a cloud server configuration
    3. 6.3 Managing multiple cloud connections
    4. 6.4 Preparing the DS8000 as cloud proxy
      1. 6.4.1 Configuring the DS8000 for the REST API proxy function
  13. Chapter 7. Configuring Data Facility Storage Management Subsystem for Transparent Cloud Tiering
    1. 7.1 DFSMS connections to cloud
    2. 7.2 Adding digital certificates to IBM Resource Access Control Facility
      1. 7.2.1 Uploading the certificate files to the z/OS host
      2. 7.2.2 Importing the certificates to RACF
    3. 7.3 Controlling access to the DFSMS cloud features
      1. 7.3.1 Controlling access to DFSMSdss
      2. 7.3.2 Controlling access to DFSMShsm
    4. 7.4 Creating a DFSMS cloud network connection by using ISMF
      1. 7.4.1 Defining a cloud network connection for Amazon S3, IBM Cloud Object Storage, or TS7700 cloud targets
      2. 7.4.2 Defining a cloud network connection for a Swift cloud object storage target
      3. 7.4.3 Using NaviQuest to manage DFSMS network connections
      4. 7.4.4 Activating the Storage Management Subsystem configuration
    5. 7.5 Enabling TCT compression with a TS7700
    6. 7.6 Using TS7700 object policies
  14. Chapter 8. Managing cloud credentials
    1. 8.1 Managing credentials by using Cloud Data Access
      1. 8.1.1 Preparing the Cloud Data Access configuration
      2. 8.1.2 Configuring the CSFKEYS general resource class
      3. 8.1.3 Entering and storing the cloud provider credentials
      4. 8.1.4 Configuring CDA to run without Crypto Express adapters
      5. 8.1.5 Deleting the cloud provider credentials
      6. 8.1.6 Troubleshooting
      7. 8.1.7 Using the CDA credentials
    2. 8.2 Legacy method to manage cloud passwords for HSM
  15. Part 3 Operation and usage
  16. Chapter 9. DFSMShsm
    1. 9.1 Cloud use overview
    2. 9.2 Cloud container management
    3. 9.3 Object management
      1. 9.3.1 Migration
      2. 9.3.2 Recall
    4. 9.4 Fast subsequent migration
    5. 9.5 Migration update and considerations
      1. 9.5.1 Command-driven migration
      2. 9.5.2 Automatic migration
      3. 9.5.3 CPU utilization considerations
    6. 9.6 Recall considerations
    7. 9.7 LIST command updates
    8. 9.8 Auditing
    9. 9.9 REPORT command
  17. Chapter 10. Using automatic migration
    1. 10.1 SMS support for automatic migration
      1. 10.1.1 Management Class updates
    2. 10.2 Storage Group affinity enhancements
    3. 10.3 Space management functions
  18. Chapter 11. Operational integration and reporting considerations
    1. 11.1 Pre-implementation reporting
    2. 11.2 Operational monitoring
      1. 11.2.1 Monitoring cloud setting changes
      2. 11.2.2 Monitoring migration activities
      3. 11.2.3 Monitoring reconnections
      4. 11.2.4 Other messages to consider
    3. 11.3 Operational reporting
      1. 11.3.1 Building reports
      2. 11.3.2 DCOLLECT reports
  19. Chapter 12. DFSMShsm full volume dump
    1. 12.1 DFSMShsm full volume dump for Transparent Cloud Tiering overview
      1. 12.1.1 DFSMShsm full volume dump use cases
      2. 12.1.2 The DUMPCLASS attribute and how it works
      3. 12.1.3 Containers
      4. 12.1.4 Objects
      5. 12.1.5 Automatic dump
      6. 12.1.6 Expiring dump copies
      7. 12.1.7 Deleting empty dump containers
    2. 12.2 Setting up a DFSMShsm full volume dump to cloud object storage
      1. 12.2.1 Defining a DFSMS cloud network
      2. 12.2.2 Defining DUMPCLASS
      3. 12.2.3 Defining a copy pool
    3. 12.3 Dumping to cloud object storage
      1. 12.3.1 Command-driven dump
      2. 12.3.2 Automatic dump
    4. 12.4 Restoring from cloud object storage
      1. 12.4.1 RECOVER
    5. 12.5 Additional operational commands
      1. 12.5.1 DDELETE
      2. 12.5.2 LIST
  20. Chapter 13. Data Facility Storage Management Subsystem full volume dump
    1. 13.1 FVD for TCT overview
      1. 13.1.1 FVD use cases and how it works
    2. 13.2 Creating an FVD to cloud object storage
    3. 13.3 Restoring an FVD from cloud object storage
    4. 13.4 Managing FVD backups
      1. 13.4.1 Use case example
  21. Appendix A. DFSMShsm enhancements for Transparent Cloud Tiering
    1. Large number of data sets
    2. Performance improvements
    3. Other considerations
  22. Appendix B. Exporting the IBM DS8000 certificate chain
    1. Certificate export with Google Chrome or Microsoft Edge
    2. Certificate export with Firefox
  23. Appendix C. Replacing communication certificates in the IBM DS8900F
    1. Installing a CA-signed certificate by using the Storage Manager GUI
    2. Installing a CA-signed certificate by using the service web interface
    3. Creating a CSR
    4. Importing the signed certificate
    5. Creating a self-signed certificate on the DS8000
  24. Related publications
    1. IBM Redbooks
    2. Online resources
    3. Help from IBM
  25. Back cover

Product information

  • Title: IBM DS8000 Transparent Cloud Tiering: DS8000 Release 9.3
  • Author(s): Alexander Warmuth, Nielson “Nino” de Carvalho
  • Release date: August 2023
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738460918