A Data Engineer’s Guide to Azure SQL Data Warehouse

2018

TL; DR

Azure SQL Data Warehouse provides a blazing fast, petabyte-scale SQL system. This all-day pre-con helps you, the data engineer, make the most of all this power by learning directly from the Microsoft Product group and industry leading consultants.

Session Details

Azure SQL Data Warehouse, Microsoft’s scale out database engine for SQL analytics in the cloud, provides a blazing fast, petabyte-scale system that can handle your most demanding analytical workloads with ease. SQL Data Warehouse takes advantage of the latest Azure hardware technology delivering up to 100x performance boosts on customer workloads. In short, Azure SQL Data Warehouse is a SQL analytics beast!

We have built this all-day pre-con to help you, the data engineer, make the most of all this power that is now at your disposal!

We’ll be bringing you in-depth technical knowledge combined with hands-on implementation experience to help you get the most from the scale out architecture and accelerate the delivery of your projects. We’ll be arming you with theoretical knowledge, hands-on knowledge, best practices, hints and scripts to ensure you leave this training with all the tools you need to be successful.

Agenda:

The day will be broken down into the following modules:

Service Architecture -Discussing the engine itself, core concepts and the basics of using the service
Designing Tables - Best practice data modelling using distributions, partitioning and performance patterns
Loading Data - Patterns for different data loading scenarios and how to optimise them
Querying Data - Deep dive into query performance, execution plans & how to avoid common performance pitfalls
Architecture Patterns - Integration techniques with other Azure components to build SQLDW into a complete architecture

Learn directly from the Microsoft Product group and industry leading consultants. Get the best of both worlds!

This pre-con will be delivered by James-Rowland Jones, Principal Program Manager at Microsoft for Azure SQL Data Warehouse, in partnership with Simon Whiteley & Terry McCann from Adatis Consulting. Simon and Terry have delivered several large-scale,real-world SQLDW projects for some of the UK’s largest Azure users to give you additional real world insights that can only be gained through extensive industry experience.

A prior knowledge of traditional data warehousing is assumed, but not strictly necessary

3 things you'll get out of this session

James Rowland-Jones's previous sessions

Agnostic, Hybrid Big Data Integration using PDW and PolyBase

PolyBase is one of the most exciting, innovative features in PDW; enabling transparent data integration with Hadoop's distributed file system (HDFS) and Windows Azure Storage Blobs (WASB). See it in action.

Demonstrating PDW integration with Hadoop & Polybase

Polybase is one of the most exciting, innovative features in PDW; enabling transparent data integration with Hadoop's distributed file system (HDFS) and soon Windows Azure Storage Blobs (WASB). See it in action.

The Art of War-Fast Track Data Warehouse & Fragmentation

When loading a Fast Track Data Warehouse it is important to ensure that your data is optimally laid out for Sequential I/O. Fragmentation is therefore the enemy. Know your enemy. Learn what it is, how it occurs and prevent it from happening to you!

Simon Whiteley's previous sessions

Behind the Hype - Architecture Trends in Data

Seasoned Data Engineer and YouTube grumbler Simon Whiteley takes us on a journey through the current industry trends and buzzwords, carving through the hype to get at the underlying ideals. Which is going to last and which is a sales gimmick? Which bandwagon might actually take you in the right strategic direction?

Nose-Dive Narratives: Slide Karaoke 2024

Get ready to wrap up a serious day of learning with a dash of humor, spontaneity, and friendly competition! SQLBits presents "Slide Karaoke" where SQLBits speakers reveal their hidden talents while vying for bragging rights. This session promises to be a one-of-a-kind experience that will leave you in stitches and awe, and the speakers scrambling for their non-existent notes!

Behind the Hype - Architecture Trends in Data

In this session, seasoned data engineer and youtube grumbler Simon Whiteley takes us on a journey through the current industry trends and buzzwords, carving through the hype to get at the underlying ideals.

Building a Lakehouse on the Microsoft Intelligent Data Platform

This session session aims to give you that context. We'll look at how spark-based engines work and how we can use them within Synapse Analytics. We'll dig into Delta, the underlying file format that enables the Lakehouse, and take a tour of how the Synapse compute engines interact with it. Finally, we'll draw out our whole Lakehouse architecture

Bringing Data Lakes to your Purview

A short, fast dive into the specific elements of Azure Purview that work well with Data Lakes, and how you implement them yourselves

Value-Driven Analytics Development

Ever spent an age releasing a data model, only to find no-one uses it? There's a better way of working, driven by both technology & agile working practices, let me tell you about Value Driven Development & DataOps

Databricks, Delta Lake and You

Databricks, Lakes & Parquet are a match made in heaven, but explode with extra power when using Delta Lake. This session will dive into the details of how Databricks Delta works and how to make the most of it.

The Azure Spark Showdown - Databricks VS Synapse Analytics

Azure now has two slick, platform-as-a-service spark offerings, but which one should you choose? A separate specialist tools or a one-size-fits-all solution? Join Simon as he compares and contrasts the spark offerings.

Azure SQL DataWarehouse: 0-100 (DWUs)

Azure SQLDW - WHAT, WHERE, WHEN and HOW to use it.

Terry McCann's previous sessions

Docker & Kubernetes for the Data Scientist

Deployment == Return on investment. This session looks to show you how to do that for Machine Learning.

Machine Learning in Azure Synapse

There is a lot of content available on Synapse for Data Engineering, but what about Machine Learning? In this session we will look at how to integrate a SparkML model in Synapse.

Rapid Requirements: Introducing the Machine Learning Canvas

In this session, we will introduce the Advancing Analytics Machine Learning Canvas and how it can be used to capture requirements for Machine Learning Projects.

Machine Learning in Azure Databricks

In this session we focus on how Spark implements Machine Learning at Scale with Spark ML.

Deploy ML models faster with Data Science DevOps

In this session I will show you how to apply DevOps practices to speed up your development cycle and ensure that you have robust deployable models. We will focus on the Azure cloud platform in particular, however this is applicable to other platforms

Enhancing relational models with graph in SQL Server 2017

This session explores SQL Server 2017's Graph processing to better understand interconnectivity and behaviour in your data.