Machine Learning and Knowledge Discovery for Engineering Systems Health Management

CHAPTER 4

Discriminative Topic Models

Hanhuai ShanAmrudin AgovicArindam Banerjee

CONTENTS

4.1    Introduction

4.2    Latent Dirichlet Allocation and Supervised Latent Dirichlet Allocation

4.2.1    Latent Dirichlet Allocation

4.2.2    Supervised Latent Dirichlet Allocation

4.3    Discriminative Latent Dirichlet Allocation

4.4    Inference and Parameter Estimation

4.4.1    Variational Approximation

4.4.1.1    Inference

4.4.1.2    Parameter Estimation

4.4.2    Variational EM Algorithm

4.4.3    Prediction

4.5    Experimental Results on ASRS Data Sets

4.5.1    DLDA Properties

4.5.1.1    Discriminative Latent Dirichlet Allocation versus Latent Dirichlet Allocation

4.5.1.2    Fast DLDA versus Other Classification Algorithms

4.5.2    Fast DLDA on ...