A Day of Azure Data Factory

2023

TL; DR

In this session we provision an Azure Data Factory (ADF) and demonstrate many uses for ADF in the modern data enterprise.

Session Details

In this session we provision an Azure Data Factory (ADF) and demonstrate many uses for ADF in the modern data enterprise, including:
- Editing ADF pipeline JSON
- Version control integration
- Copying data with the copy data activity
- Parameters and use cases for parameterization (dynamic property values and expressions)
- Design patterns for the hybrid data estate
- Loading data from an on-premises data source
- Survey newer activities
- Debugging and troubleshooting ADF pipelines
- Looping, iteration, and conditionals
- Monitoring
- Execution automation (triggers + )
- ADF REST API
- security required to interact with Azure Blob Storage, Azure SQL DB, REST API, integration runtimes, git, and on-premises (plus Key Vault)
- Provisioning and using integration runtimes

3 things you'll get out of this session

1. How to get started developing with ADF; how to navigate the development user experience. 2. How to monitor and administer ADF; security required for interaction with helpful Azure services. 3. General tips and tricks, design patterns, troubleshooting.

Andy Leonard's previous sessions

Faster SSIS

Learn tips and tricks to make SSIS perform better.

Designing an SSIS Framework

In this “demo-tastic” presentation, SSIS trainer, author, and consultant Andy Leonard explains the what, why, and how of an SSIS framework that delivers metadata-driven package execution, connections management, and centralizes logging.