Description
With the surge in big data and AI, organizations can rapidly create data products. However, the effectiveness of their analytics and machine learning models depends on the datas quality. Delta Lakes open source format offers a robust lakehouse framework over platforms like Amazon S3, ADLS, and GCS.
This practical book shows data engineers, data scientists, and data analysts how to get Delta Lake and its features up and running. The ultimate goal of building data pipelines and applications is to gain insights from data. Youll understand how your storage solution choice determines the robustness and performance of the data pipeline, from raw data to insights.
Youll learn how to:
Use modern data management and data engineering techniques
Understand how ACID transactions bring reliability to data lakes at scale
Run streaming and batch jobs against your data lake concurrently
Execute update, delete, and merge commands against your data lake
Use time travel to roll back and examine previous data versions
Build a streaming data quality pipeline following the medallion architecture
Author: Bennie Haelen, Dan Davis
Binding Type: Paperback
Publisher: OReilly Media
Published: 11/21/2023
Pages: 264
Weight: 0.95lbs
Size: 9.10h x 6.90w x 0.60d
ISBN: 9781098139728
Language: English
Reviews
There are no reviews yet.