Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Tutorial BB

Mining Twitter for Airline Consumer Sentiment

Jeffrey Oliver Breen,     President and CEO, Cambridge Aviation Research, Cambridge, MA

Contents

Introduction

What Is R?

Loading Data into R

The twitteR Package

Extracting Text from Tweets

The plyr Package

Estimating Sentiment

Loading the Opinion Lexicon

Implementing Our Sentiment Scoring Algorithm

Algorithm Sanity Check

data.frames Hold Tabular Data

Scoring the Tweets

Repeat for Each Airline

Compare the Score Distributions

Ignore the Middle

Compare with ACSI’s Customer Satisfaction Index

Scrape the ACSI Website

Compare Twitter Results with ACSI Scores

Graph the Results

Notes and Acknowledgments

References

NOTE: All of the code to collect and analyze data and produce the output plots ...