Overview
- Shows real-world implementation from the first chapter
- Demonstrates ADF concepts through their practical application
- Draws parallels that help SSIS veterans adapt to using ADF
Access this book
Tax calculation will be finalised at checkout
Other ways to access
About this book
Data engineers who need to hit the ground running will use this book to build skills in Azure Data Factory v2 (ADF). The tutorial-first approach to ADF taken in this book gets you working from the first chapter, explaining key ideas naturally as you encounter them. From creating your first data factory to building complex, metadata-driven nested pipelines, the book guides you through essential concepts in Microsoft’s cloud-based ETL/ELT platform. It introduces components indispensable for the movement and transformation of data in the cloud. Then it demonstrates the tools necessary to orchestrate, monitor, and manage those components.
The hands-on introduction to ADF found in this book is equally well-suited to data engineers embracing their first ETL/ELT toolset as it is to seasoned veterans of Microsoft’s SQL Server Integration Services (SSIS). The example-driven approach leads you through ADF pipeline construction from the ground up, introducing important ideas and making learning natural and engaging. SSIS users will find concepts with familiar parallels, while ADF-first readers will quickly master those concepts through the book’s steady building up of knowledge in successive chapters. Summaries of key concepts at the end of each chapter provide a ready reference that you can return to again and again.
What You Will Learn
Who This Book Is For
Data engineers and ETL developers taking their first steps in Azure Data Factory, SQL Server Integration Services users making the transition toward doing ETL in Microsoft’s Azure cloud, and SQL Server database administrators involved in data warehousing and ETL operations
The hands-on introduction to ADF found in this book is equally well-suited to data engineers embracing their first ETL/ELT toolset as it is to seasoned veterans of Microsoft’s SQL Server Integration Services (SSIS). The example-driven approach leads you through ADF pipeline construction from the ground up, introducing important ideas and making learning natural and engaging. SSIS users will find concepts with familiar parallels, while ADF-first readers will quickly master those concepts through the book’s steady building up of knowledge in successive chapters. Summaries of key concepts at the end of each chapter provide a ready reference that you can return to again and again.
What You Will Learn
- Create pipelines, activities, datasets, and linked services
- Build reusable components using variables, parameters, and expressions
- Move data into and around Azure services automatically
- Transform data natively using ADF data flows and Power Query data wrangling
- Master flow-of-control and triggers for tightly orchestrated pipeline execution
- Publish and monitor pipelines easily and with confidence
Who This Book Is For
Data engineers and ETL developers taking their first steps in Azure Data Factory, SQL Server Integration Services users making the transition toward doing ETL in Microsoft’s Azure cloud, and SQL Server database administrators involved in data warehousing and ETL operations
Similar content being viewed by others
Keywords
Table of contents (12 chapters)
Authors and Affiliations
About the author
Richard Swinbank is a data engineer and Microsoft Data Platform MVP. He specializes in building and automating analytics platforms using Microsoft technologies from the SQL Server stack to the Azure cloud. He is a fervent advocate of DataOps, with a technical focus on bringing automation to both analytics development and operations. An active member of the data community and keen knowledge-sharer, Richard is a volunteer, organizer, speaker, blogger, open source contributor, and author. He holds a PhD in computer science from the University of Birmingham (UK).
Bibliographic Information
Book Title: Azure Data Factory by Example
Book Subtitle: Practical Implementation for Data Engineers
Authors: Richard Swinbank
DOI: https://doi.org/10.1007/978-1-4842-7029-5
Publisher: Apress Berkeley, CA
eBook Packages: Professional and Applied Computing, Apress Access Books, Professional and Applied Computing (R0)
Copyright Information: Richard Swinbank 2021
eBook ISBN: 978-1-4842-7029-5Published: 09 June 2021
Edition Number: 1
Number of Pages: XXII, 335
Number of Illustrations: 148 b/w illustrations
Topics: Microsoft and .NET, Database Management