Skip to content
  • Sign In
  • Try Now
View all events
Prompt Engineering

Open Source GenAI with InstructLab and Granite

Published by Pearson

Intermediate content levelIntermediate

Run an open-source AI and LLM on your own laptop

  • Get started with AI and large language models without having to pay for it
  • Contribute to the open-source LLM community, even if you aren’t a machine learning expert
  • Learn how to feed data into Granite LLM and run prompts from your own environment

AI has become a big part of every professional’s daily life, and the backbone of Artificial Intelligence is the Large Language Model (LLM). Many LLMs are hard to tweak, but Granite is a new open-source LLM that provides all the capabilities of ChatGPT with the added ability to run it on your own laptop. This allows anyone to contribute to this LLM easily.

To go along with Granite, InstructLab is an open-source AI environment created by Red Hat and IBM. InstructLab allows you to learn how to work with Granite LLM in small environments, after which it will be easier to upscale and run the Granite LLM on Red Hat Enterprise Linux AI on premise or use OpenShift AI in cloud.

Join instructor Sander van Vugt as he provides an introduction to working with InstructLab and the Granite LLM. You’ll learn how to install InstructLab on your own laptop and start working with it. You’ll also learn how to feed data into the open-source Granite LLM, either in a way that makes it available to the world, or to tweak your own local copy of the LLM. Get a head start on Granite and InstructLab!

What you’ll learn and how you can apply it

  • The basics of how InstructLab AI works
  • How Granite LLM is organized
  • How to offer LLM access in a scalable way
  • How to bring a ChatGPT-like AI Environment to your own laptop
  • How to install and tweak your data with InstructLab on your own laptop

This live event is for you because...

  • You want to learn how AI works
  • You want to run an LLM environment on your own laptop, server, or cloud
  • You want to learn how to feed data into an LLM
  • You want to get access to ChatGPT-like functionality without paying for it

Prerequisites

  • Students need to be familiar with the Linux command line or the MacOS command line

Course Set-up

  • Students should have a Fedora Linux system or a MacOS system available
  • If possible, it is preferred though not required to use a system with a GPU

Recommended Preparation

Recommended Follow-up

Schedule

The time frames are only estimates and may vary according to how the class is progressing.

Segment 1: Introduction (5 minutes)

Segment 2: Introduction to InstructLab (20 minutes)

  • Types of AI
  • How does InstructLab fit in the AI landscape
  • Open Source

Segment 3: Introduction to Granite (20 minutes)

  • Understanding LLMs
  • Common LLMs
  • What makes Granite special
  • Why is it important to have an Open Source LLM

Segment 4: Requirements for using InstructLab (10 minutes)

  • Why does a GPU help
  • Requirements for Mac
  • Requirements for Linux
  • Expected future OS support

Q&A (5 minutes)

Break (5 minutes)

Segment 5: Installing InstructLab (25 minutes)

  • Understanding InstructLab installation
  • Installing InstructLab

Segment 6: Starting your first chat (25 minutes)

  • Starting your first chat
  • How to use effective chat prompts

Q&A (5 minutes)

Break (5 minutes)

Segment 7: Working with LLMs (35 minutes)

  • How does an LLM work
  • InstructLab taxonomy
  • Teaching new information to your local LLM
  • Contributing to the open-source Granite LLM

Segment 8: Scalability (15 minutes)

  • Scaling up
  • Running an LLM on your servers
  • Running an LLM in cloud

Q&A (5 minutes)

Your Instructor

  • Sander van Vugt

    Sander van Vugt has many years of experience working with, writing about, and teaching Linux and Open Source topics. He is the author of the best-selling Red Hat RHCSA Cert Guide and the Red Hat RHCSA Complete Video Course along with many other titles on topics that include RHCE, Bash, Kubernetes, Ansible and more. Sander also works as a Linux instructor, teaching on-site and online classes for customers around the world.

    linkedinXlinksearch