Big Data Processing with Apache Spark: Efficiently tackle large datasets and big data analysis with Spark and Python

bNo need to spend hours ploughing through endless data - let Spark, one of the fastest big data processing engines available, do the hard work for you./b h4Key Features/h4 ulliGet up and running with Apache Spark and Python /li liIntegrate Spark with AWS for real-time analytics /li liApply processed...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Franco Galeano, Manuel Ignacio (VerfasserIn)
Format: Elektronisch E-Book
Sprache:English
Veröffentlicht: Birmingham Packt Publishing Limited 2018
Ausgabe:1
Schlagworte:
Zusammenfassung:bNo need to spend hours ploughing through endless data - let Spark, one of the fastest big data processing engines available, do the hard work for you./b h4Key Features/h4 ulliGet up and running with Apache Spark and Python /li liIntegrate Spark with AWS for real-time analytics /li liApply processed data streams to machine learning APIs of Apache Spark /li /ul h4Book Description/h4 Processing big data in real time is challenging due to scalability, information consistency, and fault-tolerance. This book teaches you how to use Spark to make your overall analytical workflow faster and more efficient. You'll explore all core concepts and tools within the Spark ecosystem, such as Spark Streaming, the Spark Streaming API, machine learning extension, and structured streaming. You'll begin by learning data processing fundamentals using Resilient Distributed Datasets (RDDs), SQL, Datasets, and Dataframes APIs.
After grasping these fundamentals, you'll move on to using Spark Streaming APIs to consume data in real time from TCP sockets, and integrate Amazon Web Services (AWS) for stream consumption. By the end of this book, you'll not only have understood how to use machine learning extensions and structured streams but you'll also be able to apply Spark in your own upcoming big data projects.
h4What you will learn/h4 ulliWrite your own Python programs that can interact with Spark /li liImplement data stream consumption using Apache Spark /li liRecognize common operations in Spark to process known data streams /li liIntegrate Spark streaming with Amazon Web Services (AWS) /li liCreate a collaborative filtering model with the movielens dataset /li liApply processed data streams to Spark machine learning APIs/li/ul h4Who this book is for/h4 Data Processing with Apache Spark is for you if you are a software engineer, architect, or IT professional who wants to explore distributed systems and big data analytics. Although you don't need any knowledge of Spark, prior experience of working with Python is recommended
Beschreibung:1 Online-Ressource (142 Seiten)
ISBN:9781789804522

Es ist kein Print-Exemplar vorhanden.

Fernleihe Bestellen Achtung: Nicht im THWS-Bestand!