Monster Data Loading with Synapse
2022TL; DR
Get to grips with data loading in Synapse.
Session Details
So we need to load data at scale into Synapse SQL Pools. What should we be thinking about.
There are a few options for loading : COPY and Polybase does it matter which one to use. What difference does the file format make Parquet or Delta or CSV ? What above performance ? How quickly can we load a TB of data? 2TB? what about 10TB? Or more????
So lets see how much data we can load in 20 minutes...
Feedback link: https://sqlb.it/?7219
There are a few options for loading : COPY and Polybase does it matter which one to use. What difference does the file format make Parquet or Delta or CSV ? What above performance ? How quickly can we load a TB of data? 2TB? what about 10TB? Or more????
So lets see how much data we can load in 20 minutes...
Feedback link: https://sqlb.it/?7219