Intro to Linear Algebra (Machine Learning Foundations)
Published by Pearson
Manipulate Tensors in All the Major Libraries: PyTorch, TensorFlow, and NumPy
- Foundational for Machine Learning: This class serves as a critical foundation for understanding machine learning, as it covers the essential principles of linear algebra, which is at the core of all ML algorithms.
- Interactive Learning Experience: The class offers a unique interactive experience by combining theoretical knowledge with practical examples, allowing students to manipulate tensors — the key elements of linear algebra — in popular frameworks like PyTorch, TensorFlow, and NumPy.
- Gateway to Advanced Topics: As the introductory course in the ML Foundations series, it paves the way for more advanced studies, particularly in Linear Algebra for Machine Learning, Level II: Matrix Tensor and Linear Algebra for Machine Learning, Level III: Eigenvectors, ensuring a comprehensive understanding necessary for mastering the field of machine learning.
The Machine Learning Foundations series of online trainings provides a comprehensive overview of all of the subjects — mathematics, statistics, and computer science — that underlie contemporary machine learning techniques, including deep learning and other artificial intelligence approaches. Extensive curriculum detail can be found at the course’s GitHub repo. (https://github.com/jonkrohn/ML-foundations) All of the classes in the ML Foundations series bring theory to life through the combination of vivid full-color illustrations, straightforward Python examples within hands-on Jupyter notebook demos, and comprehension exercises with fully-worked solutions.
The focus is on providing you with a practical, functional understanding of the content covered. Context will be given for each topic, highlighting its relevance to machine learning. You will be better positioned to understand cutting-edge machine learning papers and you will be provided with resources for digging even deeper into topics that pique your curiosity.
There are 14 classes in the series, organized into four subject areas:
1. Linear Algebra (three classes)
- Linear Algebra for Machine Learning: Intro
- Linear Algebra for Machine Learning, Level II: Matrix Tensors
- Linear Algebra for Machine Learning, Level III: Eigenvectors
2. Calculus (four classes)
- Calculus for Machine Learning: Intro
- Calculus for Machine Learning, Level II: Automatic Differentiation
- Calculus for Machine Learning, Level III: Partial Derivatives
- Calculus for Machine Learning, Level IV: Gradients & Integrals
3. Probability and Statistics (four classes)
- Intro to Probability
- Probability II and Information Theory
- Intro to Statistics
- Statistics II: Regression and Bayesian
4. Computer Science (three classes)
- Intro to Data Structures and Algorithms
- DSA II: Hashing, Trees, and Graphs
- Optimization
Each of the four subject areas are fairly independent, however, theory within a given subject area generally builds over the 3-4 classes — topics in later classes of a given subject area often assume an understanding of topics from earlier classes. Work through the individual classes based on your particular interests or your existing familiarity with the material.
This class, Linear Algebra for Machine Learning: Intro, is the first in the Machine Learning Foundations series. It is essential because linear algebra lies at the heart of all machine learning approaches. Through the measured exposition of theory paired with interactive examples, you’ll develop an understanding of what tensors — the fundamental building blocks of linear algebra — are, as well as how to manipulate them in PyTorch, TensorFlow, and NumPy. The content covered in this class is itself foundational for all the other classes in the Machine Learning Foundations series and it is especially relevant to Linear Algebra for Machine Learning, Level II: Matrix Tensor and Linear Algebra for Machine Learning, Level III: Eigenvectors.
What you’ll learn and how you can apply it
- Understand the fundamentals of linear algebra, a ubiquitous approach for solving for unknowns within high-dimensional spaces.
- Create and manipulate tensors — the fundamental building blocks of linear algebra — in all three of the major Python tensor libraries: TensorFlow, PyTorch, and NumPy.
- Develop a geometric intuition of what’s going on beneath the hood of machine learning algorithms, including those used for deep learning.
- Be able to more intimately grasp the details of machine learning papers and textbooks.
This live event is for you because...
- You use high-level software (e.g., scikit-learn, the Keras API, PyTorch Lightning) to train or deploy machine learning algorithms, and you would now like to understand the fundamentals underlying the abstractions, enabling you to expand your capabilities.
- You’re a software developer who would like to develop a firm foundation for the deployment of machine learning algorithms into production systems.
- You’re a data scientist who would like to reinforce your understanding of the subjects at the core of your professional discipline.
- You’re a data analyst or AI enthusiast who would like to become a data scientist or data/ML engineer, and so you’re keen to deeply understand the field you’re entering from the ground up (very wise of you!).
Prerequisites
- Programming: All code demos will be in Python so experience with it or another object-oriented programming language would be helpful for following along with the code examples.
- Mathematics: Familiarity with secondary school-level mathematics will make the class easier to follow along with. If you are comfortable dealing with quantitative information -- such as understanding charts and rearranging simple equations -- then you should be well-prepared to follow along with all of the mathematics.
Course Set-up:
- During class, we’ll work on Jupyter notebooks interactively in the cloud via Google Colab. This requires zero setup and instructions will be provided in class.
Recommended Preparation:
- Watch: Linear Algebra for Machine Learning LiveLessons, Lessons 1-3 (for a head start on the content covered in class) by Jon Krohn
Note: The remainder of Jon’s ML Foundations curriculum is split across the following videos:
- _Calculus for ML LiveLessons _
- Probability and Statistics for ML LiveLessons
- Data Structures, Algorithms, and ML Optimization LiveLessons
Recommended Follow-up
- Attend: Linear Algebra for Machine Learning, Level II: Matrix Tensors (ML Foundations Series) by Jon Krohn
- Watch: Linear Algebra for ML LiveLessons by Jon Krohn
- Explore: Math for Machine Learning by Jon Krohn
- Explore: Deep Learning: The Complete Guide by Jon Krohn
Schedule
The time frames are only estimates and may vary according to how the class is progressing.
Segment 1: Orientation to Linear Algebra (60 min)
- What Linear Algebra Is
- A Brief History of Algebra
- Solving a System of Linear Equations
- Linear Algebra in Machine Learning
- Q&A: 5 minutes
- Break: 10 minutes
Segment 2: Data Structures for Algebra (60 min)
- Tensors
- Scalars
- Vectors and Vector Transposition
- Norms and Unit Vectors
- Basis, Orthgonal, and Orthonormal Vectors
- Arrays in NumPy
- Matrices
- Tensors in TensorFlow and PyTorch
- Q&A: 5 minutes
- Break: 10 minutes
Segment 3: Common Tensor Operations (60 min)
- Tensor Transposition
- Basic Tensor Arithmetic
- Reduction
- The Dot Product
- Final Exercises
- Q&A: 15 minutes
Course wrap-up and next steps (15 minutes)
Your Instructor
Jon Krohn
Jon Krohn is Co-Founder and Chief Data Scientist at the machine learning company Nebula. He authored the book Deep Learning Illustrated, an instant #1 bestseller that was translated into seven languages. He is also the host of SuperDataScience, the data science industry’s most listened-to podcast. Jon is renowned for his compelling lectures, which he offers at leading universities and conferences, as well as via his award-winning YouTube channel. He holds a PhD from Oxford and has been publishing on machine learning in prominent academic journals since 2010.