Azure Data Lake-The Services. The SQL. The Sharp.

2018

TL; DR

Let’s understand the role of this hyper-scale two tier big data technology and how to harness its power with U-SQL, the offspring of T-SQL and C#. We’ll cover everything you need to know to get started developing solutions with Azure Data Lake.

Session Details

How do we implement Azure Data Lake?
How does a lake fit into our data platform architecture? Is Data Lake going to run in isolation or be part of a larger pipeline?
How do we use and work with USQL?
Does size matter?!

The answers to all these questions and more in this session as we immerse ourselves in the lake, that’s in a cloud.

We'll take an end to end look at the components and understand why the compute and storage are separate services.

For the developers, what tools should we be using and where should we deploy our USQL scripts. Also, what options are available for handling our C# code behind and supporting assemblies.

We’ll cover everything you need to know to get started developing data solutions with Azure Data Lake.Finally, let’s extend the U-SQL capabilities with the Microsoft Cognitive Services!

3 things you'll get out of this session

Paul Andrew's other proposed sessions for 2026

An Evolution of Cloud Data Architectures - Lambda, Kappa, Delta, Mesh & Fabric - 2026

An Introduction to Delta Lake and The Lakehouse - 2026

Build a Lakehouse in a Day with Metadata & Open-Source Tools - 2026

Building Near Real-time Data Solutions in Microsoft Azure & Fabric - 2026

Data & Community: An Amazing Network Of Peers Supporting Innovation & Growth - 2026

Data Modelling: The Lost Art of Turning Inputs into Insights - 2026

Deciphering Data Architectures full-day workshop - 2026

Designing & Delivering Data Products: From Mesh Principles to Data Fabric Automation - 2026

Fabric Data Activator: Real-Time Data Feeds, Automated Alerts & Stock Intelligence - 2026

Fast-Track Your Lakehouse Build with a Metadata Framework - 2026

Microsoft Fabric Platform Governance - Where To Start - 2026

Paul Andrew's previous sessions

An Evolution of Data Architectures - Lambda, Kappa, Delta, Mesh & Fabric

How has advancements in highly scalable cloud technology influenced the design principals we apply when building data platform solutions?

Building an Azure Data Analytics Platform End-to-End

Based on real world experience let’s think about just how far the breadth of our knowledge now needs to reach when starting from nothing and building a complete Microsoft Azure Data Analytics solution.

Creating a Metadata Driven Orchestration Framework Using Azure Data Integration Pipelines

We'll explore delivering this framework within an enterprise and consider an architect’s perspective on a wider platform of ingestion/transformation workloads with multiple batches and execution stages.

ETL in Azure Made Easy with Data Factory Data Flows

What happens when you combine a cloud orchestration service with a Spark cluster?! The answer is a feature rich, graphical, scalable data flow environment to rival any ETL tech we’ve previously had available in Azure.

Using Azure DevOps for Azure Data Factory

DevOps as a concept does not always translate to the technology when implemented. In this session we'll explore that problem when working with Azure Data Factory and what the different cloud only CI/CD options are.

Complex Azure Orchestration w Dynamic Data Factory Pipelines

If you have already mastered the basics of Azure Data Factory (ADF) and are now looking to advance your knowledge of the tool this is the session for you.

Building an End to End IoT Solution Using Pi Sensors & Azure

Demonstrating an end to end IoT solution providing real-time sensor data from a Raspberry Pi into an Azure IoT Hub, through Stream Analytics, then with outputs to Power BI and SQL DB. Learn how to build this simplified IoT solution from scratch.