A Day of Azure Data Factory

1. How to get started developing with ADF; how to navigate the development user experience.
2. How to monitor and administer ADF; security required for interaction with helpful Azure services.
3. General tips and tricks, design patterns, troubleshooting.

In this session we provision an Azure Data Factory (ADF) and demonstrate many uses for ADF in the modern data enterprise, including:

  • Editing ADF pipeline JSON
  • Version control integration
  • Copying data with the copy data activity
  • Parameters and use cases for parameterization (dynamic property values and expressions)
  • Design patterns for the hybrid data estate
  • Loading data from an on-premises data source
  • Survey newer activities
  • Debugging and troubleshooting ADF pipelines
  • Looping, iteration, and conditionals
  • Monitoring
  • Execution automation (triggers + )
  • ADF REST API
  • Security required to interact with Azure Blob Storage, Azure SQL DB, REST API, integration runtimes, git, and on-premises (plus Key Vault)

Tuesday 14 March, 2023 at 9:00 am (GMT)

Andy Leonard

Theme:

Big Data & Data Engineering

Session Level:

Intermediate

Required Experience:

Familiarity with T-SQL and data integration is helpful but not necessary.

Technologies covered:

Move to the Cloud