IBM Platform Computing Integration Solutions

IBM Platform Computing Integration Solutions

by Dino Quintero, Ricardo Dobelin Barros, Ashraf Gomaa, José Higino, Archana Kumar, Majid Ouassir, Adam Parker, Joanna Wong
Released March 2013
Publisher(s): IBM Redbooks
ISBN: None

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This IBM® Redbooks® publication describes the integration of IBM Platform Symphony® with IBM BigInsights™. It includes IBM Platform LSF® implementation scenarios that use IBM System x® technologies. This IBM Redbooks publication is written for consultants, technical support staff, IT architects, and IT specialists who are responsible for providing solutions and support for IBM Platform Computing solutions.

This book explains how the IBM Platform Computing solutions and the IBM System x platform can help to solve customer challenges and to maximize systems throughput, capacity, and management. It examines the tools, utilities, documentation, and other resources that are available to help technical teams provide solutions and support for IBM Platform Computing solutions in a System x environment.

In addition, this book includes a well-defined and documented deployment model within a System x environment. It provides a planned foundation for provisioning and building large scale parallel high-performance computing (HPC) applications, cluster management, analytics workloads, and grid applications.

Table of contents

  1. Front cover
  2. Notices
    1. Trademarks
  3. Preface
    1. The team who wrote this book
    2. Now you can become a published author, too!
    3. Comments welcome
    4. Stay connected to IBM Redbooks
  4. Chapter 1. Products and portfolio for IBM Platform Computing solutions
    1. 1.1 IBM Platform LSF
      1. 1.1.1 IBM Platform LSF editions
      2. 1.1.2 IBM Platform LSF add-ons
      3. 1.1.3 New in the IBM Platform LSF V9.1 family
    2. 1.2 IBM Platform HPC
    3. 1.3 IBM Platform Symphony
      1. 1.3.1 IBM Platform Symphony edition features
      2. 1.3.2 IBM Platform Symphony add-on tools
      3. 1.3.3 New in IBM Platform Symphony V6.1
    4. 1.4 IBM Platform Cluster Manager
      1. 1.4.1 IBM Platform Cluster Manager features
      2. 1.4.2 IBM Platform Cluster Manager supported environments
  5. Chapter 2. Integration of IBM Platform Symphony and IBM InfoSphere BigInsights
    1. 2.1 IBM Platform Symphony
      1. 2.1.1 How InfoSphere BigInsights works with IBM Platform Symphony
      2. 2.1.2 The IBM Platform Symphony performance advantage
    2. 2.2 Environment
      1. 2.2.1 Preconfiguration on all nodes
    3. 2.3 Configuring InfoSphere BigInsights
    4. 2.4 Installing IBM Platform Symphony Advanced Edition
    5. 2.5 Integrating IBM Platform Symphony and InfoSphere BigInsights
    6. 2.6 Additional configuration for IBM Platform Symphony
      1. 2.6.1 Identifying the management nodes in the IBM Platform Symphony configuration
      2. 2.6.2 TCP/IP performance tuning
    7. 2.7 Benchmark tests
      1. 2.7.1 Test environment and monitoring tools
      2. 2.7.2 Results of the stand-alone benchmark for InfoSphere BigInsights V1.4
      3. 2.7.3 Results of integration for IBM Platform Symphony V5.2 and InfoSphere BigInsights V1.4
      4. 2.7.4 Advantages of integrating IBM Platform Symphony V5.2 with InfoSphere BigInsights V1.4
    8. 2.8 Adding users
      1. 2.8.1 Assumptions
      2. 2.8.2 Adding a user for the integrated cluster
    9. 2.9 Adding nodes
    10. 2.10 Troubleshooting
      1. 2.10.1 InfoSphere BigInsights
      2. 2.10.2 Increasing Java virtual memory
      3. 2.10.3 Increasing system limits
  6. Chapter 3. Implementation scenario for IBM Platform LSF
    1. 3.1 Valid hardware resources to ensure that the setup can use IBM Platform LSF
    2. 3.2 Sizing for I/O-intensive clusters
    3. 3.3 Considerations for GPGPU intensive clusters
    4. 3.4 Job queues
      1. 3.4.1 Defining queues
      2. 3.4.2 Default queue
      3. 3.4.3 Managing queues
    5. 3.5 Job scheduling
      1. 3.5.1 First come, first served
      2. 3.5.2 Preemption scheduling
      3. 3.5.3 Fairshare scheduling
      4. 3.5.4 Exclusive scheduling
      5. 3.5.5 Backfill scheduling
    6. 3.6 Goal-oriented scheduling
      1. 3.6.1 Defining a service class
      2. 3.6.2 Using a service class
    7. 3.7 Job submission
      1. 3.7.1 Job arrays
      2. 3.7.2 Lifecycle of jobs
    8. 3.8 Compute units
      1. 3.8.1 Configuring compute units
      2. 3.8.2 Using compute units
    9. 3.9 Application profiles
      1. 3.9.1 Defining application profiles
      2. 3.9.2 Using application profiles
    10. 3.10 Job submission prechecks and setup
      1. 3.10.1 Modifying a submitted job
      2. 3.10.2 Using multiple esub scripts
      3. 3.10.3 Pre-execution and post-execution job scripts
    11. 3.11 Job resizing
      1. 3.11.1 Enabling resizable jobs
      2. 3.11.2 Using application profiles
    12. 3.12 Idle job detection
    13. 3.13 Defining external resources (elims)
      1. 3.13.1 External resource gathering
      2. 3.13.2 Using an external resource
    14. 3.14 Using advance reservations
      1. 3.14.1 Defining an advance reservation
      2. 3.14.2 Using a reservation
      3. 3.14.3 Modifying an advance reservation
      4. 3.14.4 Creating a system reservation
      5. 3.14.5 Advance reservation accounting
    15. 3.15 Hyper-Threading technology
    16. 3.16 Changing the paradigm with guaranteed resources
      1. 3.16.1 Configuring guaranteed resources
      2. 3.16.2 Using guaranteed resources
      3. 3.16.3 Viewing guaranteed resources
  7. Chapter 4. Industry solutions from IBM Platform Computing
    1. 4.1 Available solutions
    2. 4.2 HPC Cloud
      1. 4.2.1 HPC Cloud challenge
      2. 4.2.2 HPC Cloud solution
      3. 4.2.3 HPC Cloud advantage
    3. 4.3 Workload Management
      1. 4.3.1 Workload Management challenge
      2. 4.3.2 Workload Management solution
      3. 4.3.3 Workload Management advantage
    4. 4.4 Big Data Analytics
      1. 4.4.1 Big Data Analytics challenge
      2. 4.4.2 Big Data Analytics solution
      3. 4.4.3 Big Data Analytics advantage
    5. 4.5 Cluster management
      1. 4.5.1 Cluster management challenge
      2. 4.5.2 Cluster management solution
      3. 4.5.3 Cluster management advantage
    6. 4.6 Solutions by industry
      1. 4.6.1 Aerospace and defense industry
      2. 4.6.2 Automotive industry
      3. 4.6.3 Aerospace, defense, and automotive advantage
      4. 4.6.4 Financial markets and insurance industry
      5. 4.6.5 Life sciences
  8. Chapter 5. Security considerations for IBM Platform Computing solutions
    1. 5.1 IBM Platform HPC
    2. 5.2 IBM Platform LSF
    3. 5.3 IBM Platform Symphony
      1. 5.3.1 Understanding users in symphony
      2. 5.3.2 Configuring the external user registry
  9. Appendix A. XML installation file for IBM InfoSphere BigInsights
  10. Related publications
    1. IBM Redbooks
    2. Other publications
    3. Online resources
    4. Help from IBM
  11. Back cover

Product information

  • Title: IBM Platform Computing Integration Solutions
  • Author(s): Dino Quintero, Ricardo Dobelin Barros, Ashraf Gomaa, José Higino, Archana Kumar, Majid Ouassir, Adam Parker, Joanna Wong
  • Release date: March 2013
  • Publisher(s): IBM Redbooks
  • ISBN: None