z/OS Distributed File Service zSeries File System Implementation z/OS V1R13

z/OS Distributed File Service zSeries File System Implementation z/OS V1R13

by Paul Rogers, Robert Hering
Released October 2012
Publisher(s): IBM Redbooks
ISBN: 9780738436401

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

The z/OS® Distributed File Service zSeries® File System (zFS) is a z/OS UNIX® file system that can be used like the Hierarchical File System (HFS). zFS file systems contain files and directories, including Access Control Lists (ACLs), that can be accessed with the z/OS HFS application programming interfaces (APIs).

zFS file systems can be mounted into the z/OS UNIX hierarchy along with other local or remote file system types (for example, HFS, TFS, AUTOMNT, NFS, and so on). zFS does not replace HFS, but it is the z/OS UNIX strategic file system and IBM® recommends migrating HFS file systems to zFS. Beginning with z/OS V1R7, there are no restrictions for file system structures that should be kept as HFS instead of zFS.

This IBM Redbooks® publication helps you to install, tailor, and configure new zFS file systems. This information can be used by system administrators who work with the zFS component of the IBM z/OS Distributed File Service base element.

The book provides a broad description of the new architecture of the zFS file system for all releases up to zFS V1R13. You can use it as a reference when converting HFS file systems to zFS file systems. It will help you to create a solution for migrating to zFS file systems, and to understand the performance differences between HFS file systems and zFS file systems.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. The team who wrote this book
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Chapter 1. zFS file systems
    1. 1.1 zSeries File System introduction
    2. 1.2 Application programming interfaces
    3. 1.3 zFS physical file system
    4. 1.4 zFS colony address space
    5. 1.5 zFS supports z/OS UNIX ACLs
    6. 1.6 zFS file system aggregates
      1. 1.6.1 Compatibility mode aggregates
      2. 1.6.2 Multifile system aggregates
    7. 1.7 Metadata cache
    8. 1.8 zFS file system clones
      1. 1.8.1 Backup file system
    9. 1.9 zFS log files
    10. 1.10 zFS recovery
    11. 1.11 zFS statement of direction
    12. 1.12 zFS sample scenarios
    13. 1.13 Layout and history of this zFS book
  5. Chapter 2. Installing and using zFS
    1. 2.1 Installing zFS
      1. 2.1.1 Changes to zFS since the initial release
    2. 2.2 Customization steps for the Distributed File Service
    3. 2.3 Customization steps for zFS
      1. 2.3.1 Customization utilities and commands
      2. 2.3.2 Steps needed to define file systems
    4. 2.4 zFS RACF definitions
      1. 2.4.1 Authority for zFS commands
      2. 2.4.2 UNIXPRIV class and BPX.SUPERUSER profile
      3. 2.4.3 Access to the zFS configuration file
    5. 2.5 BPXPRMxx definitions
      1. 2.5.1 zFS colony address space
      2. 2.5.2 zFS procedure
      3. 2.5.3 Starting zFS
      4. 2.5.4 Colony address space outside of JES control
    6. 2.6 Allocating zFS aggregates
      1. 2.6.1 zFS aggregate definitions
      2. 2.6.2 Allocating an aggregate
      3. 2.6.3 Multiple volume aggregates
      4. 2.6.4 Managing space on volumes
    7. 2.7 Formatting zFS aggregates
      1. 2.7.1 Formatting using the IOEAGFMT utility
      2. 2.7.2 Formatting using the zfsadm command
      3. 2.7.3 Formatting aggregates with the -grow option
      4. 2.7.4 Display quota information
    8. 2.8 zFS configuration file
      1. 2.8.1 Create a data set for IOEFSPRM
      2. 2.8.2 Running zFS with IOEFSPRM in a flat file
      3. 2.8.3 IOEFSPRM as a member of a PDS data set
      4. 2.8.4 Logical parmlib search
      5. 2.8.5 Dynamic configuration
    9. 2.9 Attaching an aggregate
      1. 2.9.1 Attach using the IOEFSPRM member
      2. 2.9.2 Attach using the IOEZADM program
      3. 2.9.3 Attach using the zfsadm command
    10. 2.10 Create a zFS file system
      1. 2.10.1 Create a multifile file system
      2. 2.10.2 Duplicate file system names
    11. 2.11 zFS file system mounts
      1. 2.11.1 Mounting zFS file systems
      2. 2.11.2 Mounting user file systems
      3. 2.11.3 Direct mount
      4. 2.11.4 Automount for zFS file systems
      5. 2.11.5 Dynamic creation of automounted zFS file systems
      6. 2.11.6 Mixed-case multifile file system names
      7. 2.11.7 Mounting zFS file systems using the ISHELL
    12. 2.12 zFS file systems in sysplex sharing
      1. 2.12.1 Write protection implementation
      2. 2.12.2 Mounting zFS file systems copied outside the sysplex
    13. 2.13 Increasing the physical size of an aggregate
      1. 2.13.1 Adding additional candidate volumes
      2. 2.13.2 Dynamic aggregate extension
      3. 2.13.3 Dynamic file system quota increase
      4. 2.13.4 Displaying dynamic aggregate and quota extensions
      5. 2.13.5 Growing zFS aggregates in a loop
      6. 2.13.6 zFS aggregates with a size greater than 4 GB
    14. 2.14 Working with zFS aggregates using the ISHELL
      1. 2.14.1 Creating zFS aggregates
      2. 2.14.2 Support for managing zFS aggregates and file systems
    15. 2.15 Accessing zFS files
      1. 2.15.1 Access control lists (ACLs)
    16. 2.16 Displaying aggregate information and stopping zFS
      1. 2.16.1 Displaying aggregates and file systems
      2. 2.16.2 Stop zFS command
      3. 2.16.3 LFS support for zFS shutdown
    17. 2.17 Alternate sysplex root support
      1. 2.17.1 Using the automatic replacement
      2. 2.17.2 Displaying the alternate sysplex root
      3. 2.17.3 Disabling the alternate sysplex root
      4. 2.17.4 New console messages
      5. 2.17.5 Command replacement
      6. 2.17.6 Additional requirements
      7. 2.17.7 Migration and coexistence considerations
      8. 2.17.8 zFS abnormal termination
    18. 2.18 Changing an aggregate mode
    19. 2.19 zFS application programming interfaces
      1. 2.19.1 Utility RXLSAGGR
      2. 2.19.2 Utility RXZFSMON
    20. 2.20 Rollback of zFS functions for releases before z/OS V1R6
    21. 2.21 Performance improvement for the zFS mount function
      1. 2.21.1 Special considerations for previous z/OS releases
      2. 2.21.2 Salvager utility changes
      3. 2.21.3 Concurrent log recovery
    22. 2.22 Changed VSAM share options for zFS aggregates
    23. 2.23 IOEAGFMT and IOEAGSLV authorization
      1. 2.23.1 APARs OA18981 and OA20613
      2. 2.23.2 zFS utility considerations
    24. 2.24 Terminology
    25. 2.25 zFS auditid uniqueness
      1. 2.25.1 Old-style zFS auditids
      2. 2.25.2 New format of zFS auditids
      3. 2.25.3 Changing zFS auditids
    26. 2.26 zFS read-only mount recovery
      1. 2.26.1 Failing zFS read-only mount situation
      2. 2.26.2 zFS new read-only recovery option
    27. 2.27 Quiesced zFS aggregates
      1. 2.27.1 UNIX System Services file system status information
      2. 2.27.2 zFS monitoring quiesced aggregates
    28. 2.28 Monitoring aggregate full status
      1. 2.28.1 zFS monitoring for FSFULL and AGGRFULL
      2. 2.28.2 zFS monitoring for FSFULL
      3. 2.28.3 zFS monitoring for AGGRFULL
    29. 2.29 Minor zFS updates in z/OS V1R10
      1. 2.29.1 zFS man pages support
      2. 2.29.2 zFS support of EAV volumes
    30. 2.30 DFSMSdfp indirect volume serial for zFS data sets (R12)
      1. 2.30.1 Cloning zFS file systems
      2. 2.30.2 Enabling the support
      3. 2.30.3 Cloning of zFS aggregates
      4. 2.30.4 Further sample of cloning a zFS aggregate
    31. 2.31 Changes in zFS Installation and setup in z/OS V1R13
      1. 2.31.1 Changes in zFS Installation
      2. 2.31.2 Changes in IOEPRMxx configuration options
    32. 2.32 JCL and REXX procedures to run zFS-related tasks
  6. Chapter 3. Migrating to zFS
    1. 3.1 Creating zFS file systems
      1. 3.1.1 Previous restriction for zFS aggregate names
      2. 3.1.2 Using an archive file
      3. 3.1.3 Using copytree to migrate an HFS file system to zFS
      4. 3.1.4 Using pax in copy mode to migrate an HFS file system to zFS
      5. 3.1.5 REXX procedure COPYPAX
    2. 3.2 Moving the HFS root to zFS
      1. 3.2.1 Creating a compatibility mode aggregate
      2. 3.2.2 Copying the HFS root data into the zFS file system
      3. 3.2.3 Using the chroot command to test the new zFS file system
      4. 3.2.4 IPLing the system with the zFS file system as the root
      5. 3.2.5 Switching from an HFS to a zFS version root without an IPL
      6. 3.2.6 The impact of stopping zFS for other mounted file systems
    3. 3.3 Automount facility for zFS
      1. 3.3.1 Setting up the automount facility
      2. 3.3.2 Defining the automount multifile system aggregate
      3. 3.3.3 Automount assistance for HFS-to-zFS migration
    4. 3.4 Logical file system support for zFS in z/OS V1R7
      1. 3.4.1 Migration and coexistence considerations
      2. 3.4.2 Considerations for migrated data sets
      3. 3.4.3 zFS file system considerations
    5. 3.5 Migration tool BPXWH2Z
      1. 3.5.1 Using BPXWH2Z
      2. 3.5.2 Enhancements of the pax utility
      3. 3.5.3 Converting multiple file systems
      4. 3.5.4 Enhancements to BPXWH2Z
      5. 3.5.5 Using BPXWH2C in batch mode
    6. 3.6 Alternate HFS-to-zFS migration tool
      1. 3.6.1 Implementation and references
      2. 3.6.2 MIGRTOOL functions and choices
    7. 3.7 Replacing or migrating the sysplex root file system
      1. 3.7.1 The sysplex root
      2. 3.7.2 Sysplex root replacement
      3. 3.7.3 Restrictions for replacement
      4. 3.7.4 Sample processing
  7. Chapter 4. Backup and recovery
    1. 4.1 Backup file system
      1. 4.1.1 Create a file system clone
      2. 4.1.2 Using the clone
      3. 4.1.3 Updating the clone
    2. 4.2 Aggregate recovery
      1. 4.2.1 The ioeagslv command
      2. 4.2.2 Using the Salvager utility
    3. 4.3 Backing up zFS aggregates
      1. 4.3.1 Restoring the backup
      2. 4.3.2 Using a clone for taking a backup
      3. 4.3.3 Using IDCAMS REPRO
      4. 4.3.4 Catalog indication for zFS aggregates
      5. 4.3.5 Restrictions on quiescing zFS aggregates
      6. 4.3.6 UNQUIESCE modify command
      7. 4.3.7 Using a started task to unquiesce zFS aggregates
    4. 4.4 Abend handling and hang conditions
      1. 4.4.1 Conditional asserts
      2. 4.4.2 Recovery code for End of Memory failures
      3. 4.4.3 zFS hang detection
      4. 4.4.4 Command to break hangs
    5. 4.5 zFS Internal Restart
      1. 4.5.1 zFS internal restart processing
      2. 4.5.2 Previous behavior on zFS internal errors or abort
      3. 4.5.3 zFS internal restart
      4. 4.5.4 Forcing a zFS internal restart
      5. 4.5.5 Results of the zFS restart
    6. 4.6 zFS automatic re-enablement of disabled aggregates
      1. 4.6.1 Behavior in previous releases
      2. 4.6.2 The new R13 automatic re-enablement of disabled aggregates
      3. 4.6.3 Sample messages on automatic re-enablement
    7. 4.7 Problem determination
      1. 4.7.1 Trace data set
      2. 4.7.2 zFS abends and trace output
      3. 4.7.3 Debugging using the trace
      4. 4.7.4 Taking a zFS-related dump dynamically
      5. 4.7.5 Analyzing hang conditions
      6. 4.7.6 zFS bpxmtext enhancements
  8. Chapter 5. Sysplex considerations
    1. 5.1 zFS shared sysplex support
      1. 5.1.1 Compatibility mode file systems
      2. 5.1.2 Multiple file system aggregates
    2. 5.2 Automount for compatibility mode file systems
    3. 5.3 zFS remount considerations
      1. 5.3.1 Remount processing in sysplex sharing
      2. 5.3.2 zFS remount considerations
      3. 5.3.3 Switching from R/O to R/W and back again to R/O
    4. 5.4 Logical file system support of zFS in z/OS V1R6
      1. 5.4.1 New LFS support for zFS
      2. 5.4.2 Example of the sysplex sharing support
      3. 5.4.3 Automove behavior with z/OS releases between V1R6 and V1R8
      4. 5.4.4 More detailed examples for the new LFS support
      5. 5.4.5 Mounting zFS file systems R/O
    5. 5.5 Effects on applications having zFS files open
      1. 5.5.1 Small application opening files in a zFS file system
      2. 5.5.2 Stopping zFS being transparent for applications in z/OS V1R8
    6. 5.6 Multifile system aggregates behavior when zFS stops
      1. 5.6.1 Stopping zFS
    7. 5.7 Deny mount of multifile system aggregate
    8. 5.8 Sysplex awareness of the zfsadm command interface
      1. 5.8.1 New zfsadm command functions
      2. 5.8.2 The zFS sysplex group
    9. 5.9 zFS file system sharing enhancements in z/OS V1R11 base
      1. 5.9.1 Main file system sharing concepts before z/OS V1R11
      2. 5.9.2 UNIX System Services file system sharing disadvantages for read-write file systems
      3. 5.9.3 zFS support in UNIX System Services sysplex sharing prior to z/OS V1R11
      4. 5.9.4 zFS configuration options in z/OS V1R11 (base code)
      5. 5.9.5 zFS sysplex-aware in z/OS V1R11 for R/W mounts
      6. 5.9.6 Read-only mounted file systems (sysplex-aware)
      7. 5.9.7 z/OS UNIX file system ownership versus zFS aggregate ownership
      8. 5.9.8 zFS Admin support in z/OS V1R11
      9. 5.9.9 zfsadm commands in z/OS V1R11
    10. 5.10 zFS sysplex migration scenarios (R11 base code)
      1. 5.10.1 zFS migration support for z/OS V1R11
      2. 5.10.2 zFS aggregate mounted on a system prior to z/OS V1R11
      3. 5.10.3 zFS aggregate mounted on z/OS V1R11 system (sysplex=off)
      4. 5.10.4 zFS aggregate mounted on z/OS V1R11 system (sysplex=on)
      5. 5.10.5 Further migration considerations for zFS in z/OS V1R11
      6. 5.10.6 Exploiting the UNIX Unmount (Remount) samemode
    11. 5.11 zFS sysplex-aware on a file system basis (R11 OA29619)
      1. 5.11.1 zFS APAR OA29619
      2. 5.11.2 Some information about zFS sysplex sharing behavior
      3. 5.11.3 zFS R/W mounted file system being sysplex-unaware
      4. 5.11.4 zFS being sysplex-aware in z/OS V1R11 for R/W mounts
      5. 5.11.5 New and older important zFS configuration options
      6. 5.11.6 Setting up the zFS parameters
      7. 5.11.7 Using sysplex=filesys
      8. 5.11.8 zFS sysplex-aware on a file system basis
      9. 5.11.9 Running zFS sysplex-aware considerations
      10. 5.11.10 Benefits of and recommendations for the new support
      11. 5.11.11 z/OS UNIX directory caching display tool
      12. 5.11.12 File system monitoring tool FSMON
    12. 5.12 zFS Direct I/O and zFS installation changes (R13)
      1. 5.12.1 zFS sysplex support
      2. 5.12.2 Sysplex unaware read-write file system
      3. 5.12.3 z/OS V1R11 sysplex-aware read-write file system
      4. 5.12.4 zFS sysplex-aware on a file system basis
      5. 5.12.5 z/OS V1R13 Direct I/O sysplex-aware read-write file system
      6. 5.12.6 Migration considerations
      7. 5.12.7 zFS health check for sysplex=filesys
      8. 5.12.8 Sample calculations for DASD space
  9. Chapter 6. Performance and tuning
    1. 6.1 File system access
      1. 6.1.1 IOEFSPRM parameter file
    2. 6.2 User file cache
    3. 6.3 Metadata cache
      1. 6.3.1 Metadata cache monitoring
      2. 6.3.2 Metadata cache storage
    4. 6.4 Log file cache
      1. 6.4.1 zFS log files
      2. 6.4.2 Log file usage
    5. 6.5 Directory cache and large directories
      1. 6.5.1 Changing the default setting for the zFS dir_cache_size
      2. 6.5.2 Large directories
    6. 6.6 Performance monitoring APIs
    7. 6.7 RMF support for zFS
      1. 6.7.1 zFS cache monitoring
    8. 6.8 RMF zFS Summary Report
      1. 6.8.1 Report field descriptions
    9. 6.9 RMF Detail reports
      1. 6.9.1 I/O details report
      2. 6.9.2 User and vnode cache detail reports
      3. 6.9.3 Metadata and transaction cache detail reports
    10. 6.10 RMF zFS Activity Report
      1. 6.10.1 Field descriptions
    11. 6.11 RMF new messages
    12. 6.12 New RMF PM resources and metrics
    13. 6.13 RMF migration and coexistence considerations
    14. 6.14 zFS performance and other parameter settings
      1. 6.14.1 zFS user cache
      2. 6.14.2 zFS vnode cache
      3. 6.14.3 Automatic aggregate growing
      4. 6.14.4 zFS sync interval
      5. 6.14.5 New block security
      6. 6.14.6 Read ahead of user file data
      7. 6.14.7 zFS directory and metadata cache
    15. 6.15 HFS and zFS file system comparison
      1. 6.15.1 Description of the test environment
      2. 6.15.2 Comparison results
    16. 6.16 Performance comparisons with sysplex-sharing (R11)
      1. 6.16.1 Test environments - description and setup
      2. 6.16.2 Test results
    17. 6.17 Performance comparisons with sysplex-sharing (R13)
      1. 6.17.1 Setup and description of the test environments
      2. 6.17.2 Test results
  10. Chapter 7. Domino performance with zFS
    1. 7.1 Domino and zFS performance
    2. 7.2 The Domino server environment
      1. 7.2.1 Tasks performed by the Domino server
      2. 7.2.2 Test results
      3. 7.2.3 Client-driven workloads
      4. 7.2.4 Domino performance conclusions
  11. Appendix A. zFS configuration file sample
    1. A.1 IOEFSPRM configuration file
  12. Appendix B. REXX utility procedures
    1. B.1 Creating the tools
    2. B.2 RXIOE
    3. B.3 RXZFS
    4. B.4 COPYPAX
    5. B.5 ADDMNTPS
    6. B.6 CN procedure
    7. B.7 CNFZFS
    8. B.8 SU procedure
    9. B.9 LARGEFIL procedure
    10. B.10 LARGEIOS procedure
    11. B.11 LARGESCD procedure
    12. B.12 UNIX script zfsgrow
    13. B.13 RXLSAGGR procedure
    14. B.14 RXZFSMON procedure
    15. B.15 MOVEAGGR procedure
    16. B.16 RXBATCH procedure
    17. B.17 REXX
    18. B.18 RXDOWNER and ZFSOWNER
    19. B.19 LARGEFIL procedure (version 2)
    20. B.20 LARGEIOS procedure (version 2)
    21. B.21 LARGESCD procedure (version 2)
  13. Appendix C. JCL samples
    1. C.1 Using the JCL examples
    2. C.2 JCL examples using RXZFS and RXIOE
    3. C.3 AMS, TSO, and IOEAGFMT examples
    4. C.4 Migration JCL examples
    5. C.5 MVS system command samples
    6. C.6 Compare HFS and zFS
    7. C.7 JCL for an aggregate backup and restore
    8. C.8 Comparison in UNIX System Services sysplex sharing environments
  14. Appendix D. zFS performance data
    1. D.1 Output data of a modify zfs command
    2. D.2 Output data of a zfsadm query command
    3. D.3 Output data of a z/OS V1R7 zfsadm query command
  15. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Referenced websites
    4. How to get IBM Redbooks
    5. IBM Redbooks collections
  16. Back cover

Product information

  • Title: z/OS Distributed File Service zSeries File System Implementation z/OS V1R13
  • Author(s): Paul Rogers, Robert Hering
  • Release date: October 2012
  • Publisher(s): IBM Redbooks
  • ISBN: 9780738436401