Deep Learning through Sparse and Low-Rank Modeling

Chapter 1

Introduction

Zhangyang Wang^⁎; Ding Liu^{†    ⁎}Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States^†Beckman Institute for Advanced Science and Technology, Urbana, IL, United States

Abstract

Deep learning has achieved prevailing success in a wide domain of machine learning and computer vision fields. On the other hand, sparsity and low-rankness have been popular regularizations in classical machine learning. This section is intended as a brief introduction to the basics if deep learning, and then focuses on its inherent connections to the concepts of sparsity and low-rankness.

Keywords

Sparsity; Low rank; Deep learning

Chapter Outline

• 1.1  Basics of Deep Learning
• 1.2   ...