Statistical Learning with Sparsity

Statistical Learning with Sparsity

by Trevor Hastie, Robert Tibshirani, Martin Wainwright
Released May 2015
Publisher(s): Chapman and Hall/CRC
ISBN: 9781498712170

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Discover New Methods for Dealing with High-Dimensional Data

A sparse statistical model has only a small number of nonzero parameters or weights; therefore, it is much easier to estimate and interpret than a dense model. Statistical Learning with Sparsity: The Lasso and Generalizations presents methods that exploit sparsity to help recover the underlying signal in a set of data.

Top experts in this rapidly evolving field, the authors describe the lasso for linear regression and a simple coordinate descent algorithm for its computation. They discuss the application of ℓ1 penalties to generalized linear models and support vector machines, cover generalized penalties such as the elastic net and group lasso, and review numerical methods for optimization. They also present statistical inference methods for fitted (lasso) models, including the bootstrap, Bayesian methods, and recently developed approaches. In addition, the book examines matrix decomposition, sparse multivariate analysis, graphical models, and compressed sensing. It concludes with a survey of theoretical results for the lasso.

In this age of big data, the number of features measured on a person or object can be large and might be larger than the number of observations. This book shows how the sparsity assumption allows us to tackle these problems and extract useful and reproducible patterns from big datasets. Data analysts, computer scientists, and theorists will appreciate this thorough and up-to-date treatment of sparse statistical modeling.

Table of contents

  1. Front Cover (1/2)
  2. Front Cover (2/2)
  3. Contents (1/2)
  4. Contents (2/2)
  5. Preface
  6. Chapter 1: Introduction (1/2)
  7. Chapter 1: Introduction (2/2)
  8. Chapter 2: The Lasso for Linear Models (1/5)
  9. Chapter 2: The Lasso for Linear Models (2/5)
  10. Chapter 2: The Lasso for Linear Models (3/5)
  11. Chapter 2: The Lasso for Linear Models (4/5)
  12. Chapter 2: The Lasso for Linear Models (5/5)
  13. Chapter 3: Generalized Linear Models (1/6)
  14. Chapter 3: Generalized Linear Models (2/6)
  15. Chapter 3: Generalized Linear Models (3/6)
  16. Chapter 3: Generalized Linear Models (4/6)
  17. Chapter 3: Generalized Linear Models (5/6)
  18. Chapter 3: Generalized Linear Models (6/6)
  19. Chapter 4: Generalizations of the Lasso Penalty (1/8)
  20. Chapter 4: Generalizations of the Lasso Penalty (2/8)
  21. Chapter 4: Generalizations of the Lasso Penalty (3/8)
  22. Chapter 4: Generalizations of the Lasso Penalty (4/8)
  23. Chapter 4: Generalizations of the Lasso Penalty (5/8)
  24. Chapter 4: Generalizations of the Lasso Penalty (6/8)
  25. Chapter 4: Generalizations of the Lasso Penalty (7/8)
  26. Chapter 4: Generalizations of the Lasso Penalty (8/8)
  27. Chapter 5: Optimization Methods (1/9)
  28. Chapter 5: Optimization Methods (2/9)
  29. Chapter 5: Optimization Methods (3/9)
  30. Chapter 5: Optimization Methods (4/9)
  31. Chapter 5: Optimization Methods (5/9)
  32. Chapter 5: Optimization Methods (6/9)
  33. Chapter 5: Optimization Methods (7/9)
  34. Chapter 5: Optimization Methods (8/9)
  35. Chapter 5: Optimization Methods (9/9)
  36. Chapter 6: Statistical Inference (1/6)
  37. Chapter 6: Statistical Inference (2/6)
  38. Chapter 6: Statistical Inference (3/6)
  39. Chapter 6: Statistical Inference (4/6)
  40. Chapter 6: Statistical Inference (5/6)
  41. Chapter 6: Statistical Inference (6/6)
  42. Chapter 7: Matrix Decompositions, Approximations, and Completion (1/7)
  43. Chapter 7: Matrix Decompositions, Approximations, and Completion (2/7)
  44. Chapter 7: Matrix Decompositions, Approximations, and Completion (3/7)
  45. Chapter 7: Matrix Decompositions, Approximations, and Completion (4/7)
  46. Chapter 7: Matrix Decompositions, Approximations, and Completion (5/7)
  47. Chapter 7: Matrix Decompositions, Approximations, and Completion (6/7)
  48. Chapter 7: Matrix Decompositions, Approximations, and Completion (7/7)
  49. Chapter 8: Sparse Multivariate Methods (1/8)
  50. Chapter 8: Sparse Multivariate Methods (2/8)
  51. Chapter 8: Sparse Multivariate Methods (3/8)
  52. Chapter 8: Sparse Multivariate Methods (4/8)
  53. Chapter 8: Sparse Multivariate Methods (5/8)
  54. Chapter 8: Sparse Multivariate Methods (6/8)
  55. Chapter 8: Sparse Multivariate Methods (7/8)
  56. Chapter 8: Sparse Multivariate Methods (8/8)
  57. Chapter 9: Graphs and Model Selection (1/6)
  58. Chapter 9: Graphs and Model Selection (2/6)
  59. Chapter 9: Graphs and Model Selection (3/6)
  60. Chapter 9: Graphs and Model Selection (4/6)
  61. Chapter 9: Graphs and Model Selection (5/6)
  62. Chapter 9: Graphs and Model Selection (6/6)
  63. Chapter 10: Signal Approximation and Compressed Sensing (1/4)
  64. Chapter 10: Signal Approximation and Compressed Sensing (2/4)
  65. Chapter 10: Signal Approximation and Compressed Sensing (3/4)
  66. Chapter 10: Signal Approximation and Compressed Sensing (4/4)
  67. Chapter 11: Theoretical Results for the Lasso (1/6)
  68. Chapter 11: Theoretical Results for the Lasso (2/6)
  69. Chapter 11: Theoretical Results for the Lasso (3/6)
  70. Chapter 11: Theoretical Results for the Lasso (4/6)
  71. Chapter 11: Theoretical Results for the Lasso (5/6)
  72. Chapter 11: Theoretical Results for the Lasso (6/6)
  73. Bibliography (1/5)
  74. Bibliography (2/5)
  75. Bibliography (3/5)
  76. Bibliography (4/5)
  77. Bibliography (5/5)
  78. Back Cover

Product information

  • Title: Statistical Learning with Sparsity
  • Author(s): Trevor Hastie, Robert Tibshirani, Martin Wainwright
  • Release date: May 2015
  • Publisher(s): Chapman and Hall/CRC
  • ISBN: 9781498712170