Best practices on Building a Big Data Analytics Solution

2018

TL; DR

Hands-on best practices on Building a Big Data Analytics Solution with Azure Data Lake Analytics

Session Details

From theory to implementation - follow the steps of implementing an end-to-end analytics solution illustrated with some best practices and examples in Azure Data Lake.

During this full training day we will share the architecture patterns, tooling, learnings and tips and tricks for building such services on Azure Data Lake. We take you through some anti-patterns and best practices on data loading and organization, give you hands-on time and the ability to develop some of your own U-SQL scripts to process your data and discuss the pros and cons of files versus tables.

Pre-requisites
Have a core understanding of SQL (T-SQL, U-SQL etc) and some initial programming understanding.
Laptop Required:Yes

Spec: Enough to install Visual Studio 2015 or 2017 Community Edition and ADL Tooling

3 things you'll get out of this session

Michael Rys's previous sessions

Big Data & Data W'housing Together w/ Azure Synapse Analytic

Come learn how Azure Synapse brings together big data and data warehousing through new technology and a unified development experience

Big Data Processing with .NET and Spark

Come learn how to use .NET and Spark together in Azure Synapse and elsewhere to cook and analyze your data!

Execute your custom code in Python/.Net/R @ Scale with U-SQL

In this session, I will showcase how you can bring your Python, R, and .NET code to Azure Data Lake and apply it at scale using U-SQL.

Modernizing ETL with Azure Data Lake

Modernizing ETL with Azure Data Lake: Hyperscale, Multi-format, Multi-platform, & Intelligent

Scaling out your Cloud Database with SQL Azure Federations

In this presentation, we provide an introduction to SQL Azure Federations and also show some interesting patterns that provide additional capabilities such as scale-out query processing, cross-shard schema management and multi-key sharding.