Python In Microsoft Fabric: Execution Options And Scaling
Proposed session for SQLBits 2026TL; DR
Explore Python execution options in Microsoft Fabric to optimize performance, reduce costs, and scale workloads without relying solely on Spark compute.
Session Details
When the running costs of PySpark is putting you off but you don't know a way around it, Microsoft Fabric is to the rescue. Spark compute isn't essential for all data ingestion and transformation workloads and we can leverage different libraries to optimise performance and costs.
In this session, attendees will see the available options for using python and code-first approaches in Fabric, demonstrated by the pros, the cons and a few use cases. We'll also frame this all into a scalable and forward-thinking pattern that allows cost savings now, and growth in the future.
This session is for those getting started with Fabric who are conscious about cost, performance and using the appropriate tools for the job.
In this session, attendees will see the available options for using python and code-first approaches in Fabric, demonstrated by the pros, the cons and a few use cases. We'll also frame this all into a scalable and forward-thinking pattern that allows cost savings now, and growth in the future.
This session is for those getting started with Fabric who are conscious about cost, performance and using the appropriate tools for the job.
3 things you'll get out of this session
- Present the options for using python within Fabric
- Demonstrate performance bottlenecks using different python libraries and compute options.
- Provide a scalable framework for adopting code‑first patterns that balance savings today with future growth.
Speakers
Matt Collins's other proposed sessions for 2026
Build a Lakehouse in a Day with Metadata & Open-Source Tools - 2026
Fast-Track Your Lakehouse Build with a Metadata Framework - 2026
Metadata To Mermaid Diagrams: Visualising Pipeline Lineage At Runtime - 2026
Rapid Data Insight Delivery - Breaking The Barrier To Entry For SMBs - 2026