Fast Data Processing with Spark 2 - Third Edition

Learn how to use Spark to process big data at speed and scale for sharper analytics. Put the principles into practice for faster slicker big data projects. About This Book • A quick way to get started with Spark – and reap the rewards • From analytics to engineering your big data architecture weve got it covered • Bring your Scala and Java knowledge – and put it to work on new and exciting problems Who This Book Is For This book is for developers with little to no knowledge of Spark but with a background in Scala/Java programming. Its recommended that you have experience in dealing and working with big data and a strong interest in data science. What You Will Learn • Install and set up Spark in your cluster • Prototype distributed applications with Sparks interactive shell • Perform data wrangling using the new DataFrame APIs • Get to know the different ways to interact with Sparks distributed representation of data (RDDs) • Query Spark with a SQL-like query syntax • See how Spark works with big data • Implement machine learning systems with highly scalable algorithms • Use R the popular statistical language to work with Spark • Apply interesting graph algorithms and graph processing with GraphX In Detail When people want a way to process big data at speed Spark is invariably the solution. With its ease of development (in comparison to the relative complexity of Hadoop) its unsurprising that its becoming popular with data analysts and engineers everywhere. Beginning with the fundamentals well show you how to get set up with Spark with minimum fuss. Youll then get to grips with some simple APIs before investigating machine learning and graph processing – throughout well make sure you know exactly how to apply your knowledge. You will also learn how to use the Spark shell how to load data before finding out how to build and run your own Spark applications. Discover how to manipulate your RDD and get stuck into a range of DataFrame APIs. As if thats not enough youll also learn some useful Machine Learning algorithms with the help of Spark MLlib and integrating Spark with R. Well also make sure youre confident and prepared for graph processing as you learn more about the GraphX API. Style and approach This book is a basic step-by-step tutorial that will help you take advantage of all that Spark has to offer.