bDesign, implement, and deliver successful streaming applications, machine learning pipelines and graph applications using Spark SQL API /bh2About This Book/h2ulliLearn about the design and implementation of streaming applications, machine learning pipelines, deep learning, and large-scale graph pro...

Ausführliche Beschreibung

Bibliographische Detailangaben

1. Verfasser:	Sarkar, Aurobindo (VerfasserIn)
Format:	Elektronisch E-Book
Sprache:	English
Veröffentlicht:	Birmingham Packt Publishing Limited 2017
Ausgabe:	1
Schlagworte:	COMPUTERS / Data Modeling &amp Design COMPUTERS / Data Processing
Zusammenfassung:	bDesign, implement, and deliver successful streaming applications, machine learning pipelines and graph applications using Spark SQL API /bh2About This Book/h2ulliLearn about the design and implementation of streaming applications, machine learning pipelines, deep learning, and large-scale graph processing applications using Spark SQL APIs and Scala./liliLearn data exploration, data munging, and how to process structured and semi-structured data using real-world datasets and gain hands-on exposure to the issues and challenges of working with noisy and "dirty" real-world data./liliUnderstand design considerations for scalability and performance in web-scale Spark application architectures./li/ulh2Who This Book Is For/h2If you are a developer, engineer, or an architect and want to learn how to use Apache Spark in a web-scale project, then this is the book for you. It is assumed that you have prior knowledge of SQL querying. A basic programming knowledge with Scala, Java, R, or Python is all you need to get started with this book.h2What You Will Learn/h2ulliFamiliarize yourself with Spark SQL programming, including working with DataFrame/Dataset API and SQL/liliPerform a series of hands-on exercises with different types of data sources, including CSV, JSON, Avro, MySQL, and MongoDB/liliPerform data quality checks, data visualization, and basic statistical analysis tasks/liliPerform data munging tasks on publically available datasets/liliLearn how to use Spark SQL and Apache Kafka to build streaming applications/liliLearn key performance-tuning tips and tricks in Spark SQL applications/liliLearn key architectural components and patterns in large-scale Spark SQL applications/li/ulh2In Detail/h2In the past year, Apache Spark has been increasingly adopted for the development of distributed applications. Spark SQL APIs provide an optimized interface that helps developers build such applications quickly and easily. However, designing web-scale production applications using Spark SQL APIs can be a complex task. Hence, understanding the design and implementation best practices before you start your project will help you avoid these problems.This book gives an insight into the engineering practices used to design and build real-world, Spark-based applications. The book's hands-on examples will give you the required confidence to work on any future projects you encounter in Spark SQL.It starts by familiarizing you with data exploration and data munging tasks using Spark SQL and Scala. Extensive code examples will help you understand the methods used to implement typical use-cases for various types of applications. You will get a walkthrough of the key concepts and terms that are common to streaming, machine learning, and graph applications.
Beschreibung:	1 Online-Ressource (452 Seiten)
ISBN:	9781785887352