Book description
Learn about the fastest-growing open source project in the world, and find out how it revolutionizes big data analytics
About This Book
Exclusive guide that covers how to get up and running with fast data processing using Apache Spark
Explore and exploit various possibilities with Apache Spark using real-world use cases in this book
Want to perform efficient data processing at real time? This book will be your one-stop solution.
Who This Book Is For
This guide appeals to big data engineers, analysts, architects, software engineers, even technical managers who need to perform efficient data processing on Hadoop at real time. Basic familiarity with Java or Scala will be helpful.
The assumption is that readers will be from a mixed background, but would be typically people with background in engineering/data science with no prior Spark experience and want to understand how Spark can help them on their analytics journey.
What You Will Learn
Get an overview of big data analytics and its importance for organizations and data professionals
Delve into Spark to see how it is different from existing processing platforms
Understand the intricacies of various file formats, and how to process them with Apache Spark.
Realize how to deploy Spark with YARN, MESOS or a Stand-alone cluster manager.
Learn the concepts of Spark SQL, SchemaRDD, Caching and working with Hive and Parquet file formats
Understand the architecture of Spark MLLib while discussing some of the off-the-shelf algorithms that come with Spark.
Introduce yourself to the deployment and usage of SparkR.
Walk through the importance of Graph computation and the graph processing systems available in the market
Check the real world example of Spark by building a recommendation engine with Spark using ALS.
Use a Telco data set, to predict customer churn using Random Forests.
In Detail
Spark juggernaut keeps on rolling and getting more and more momentum each day. Spark provides key capabilities in the form of Spark SQL, Spark Streaming, Spark ML and Graph X all accessible via Java, Scala, Python and R. Deploying the key capabilities is crucial whether it is on a Standalone framework or as a part of existing Hadoop installation and configuring with Yarn and Mesos.
The next part of the journey after installation is using key components, APIs, Clustering, machine learning APIs, data pipelines, parallel programming. It is important to understand why each framework component is key, how widely it is being used, its stability and pertinent use cases.
Once we understand the individual components, we will take a couple of real life advanced analytics examples such as ‘Building a Recommendation system’, ‘Predicting customer churn’ and so on.
The objective of these real life examples is to give the reader confidence of using Spark for real-world problems.
Style and approach
With the help of practical examples and real-world use cases, this guide will take you from scratch to building efficient data applications using Apache Spark.
You will learn all about this excellent data processing engine in a step-by-step manner, taking one aspect of it at a time.
This highly practical guide will include how to work with data pipelines, dataframes, clustering, SparkSQL, parallel programming, and such insightful topics with the help of real-world use cases.
Table of contents
-
Learning Apache Spark 2
- Learning Apache Spark 2
- Credits
- About the Author
- About the Reviewers
- www.packtpub.com
- Customer Feedback
- Preface
- 1. Architecture and Installation
- 2. Transformations and Actions with Spark RDDs
- 3. ETL with Spark
- 4. Spark SQL
- 5. Spark Streaming
-
6. Machine Learning with Spark
- What is machine learning?
- Why machine learning?
- Types of machine learning
- Introduction to Spark MLLib
- Why do we need the Pipeline API?
- How does it work?
- Feature engineering
- Classification and regression
- Clustering
- Collaborative filtering
- ML-tuning - model selection and hyperparameter tuning
- References
- Summary
- 7. GraphX
- 8. Operating in Clustered Mode
- 9. Building a Recommendation System
-
10. Customer Churn Prediction
- Overview of customer churn
- Why is predicting customer churn important?
- How do we predict customer churn with Spark?
- Exploring customer service calls
- References
- Summary
- Theres More with Spark
Product information
- Title: Learning Apache Spark 2
- Author(s):
- Release date: March 2017
- Publisher(s): Packt Publishing
- ISBN: 9781785885136
You might also like
book
Hands-On Deep Learning with Apache Spark
Speed up the design and implementation of deep learning solutions using Apache Spark Key Features Explore …
book
Mastering Apache Spark 2.x - Second Edition
Advanced analytics on your Big Data with latest Apache Spark 2.x About This Book An advanced …
video
Debugging Apache Spark
Apache Spark is an extremely powerful general purpose distributed system that also happens to be extremely …
book
Apache Spark 2.x Cookbook
Over 70 recipes to help you use Apache Spark as your single big data computing platform …