Microsoft Fabric - Lakehouse and Medallion Architecture
Tutorial
In this video Ed Freeman looks at the Lakehouse and Medallion Architecture concepts, and how they relate to Microsoft Fabric.
Lakehouses have become a common foundational design pattern for modern data platforms, and have risen in popularity over the last few years after tools like Databricks, and now Microsoft Fabric, have standardized on the design. The Medallion Architecture refers to a three-tiered architectural blueprint, with data moving through different stages of state, each stage serving different purposes.
The talk contains the following chapters:
- 00:00 Intro
- 00:22 What is a Lakehouse?
- 02:10 What is a Lakehouse in Microsoft Fabric?
- 04:43 Table and File structure in OneLake
- 05:19 Justification for Medallion architecture
- 06:13 Medallion architecture overview
- 07:00 Bronze layer
- 08:15 Silver layer
- 08:45 Gold layer
- 09:50 Replayability & idempotency
- 10:56 Alternative structures
- 11:52 Outro
Useful links:
Microsoft Fabric End to End Demo Series:
- Part 1 - Lakehouse & Medallion Architecture
- Part 2 - Plan and Architect a Data Project
- Part 3 - Ingest Data
- Part 4 - Creating a shortcut to ADLS Gen2 in Fabric
- Part 5 - Local OneLake Tools
- Part 6 - Role of the Silver Layer in the Medallion Architecture
- Part 7 - Processing Bronze to Silver using Fabric Notebooks
- Part 8 - Good Notebook Development Practices
From Descriptive to Predictive Analytics with Microsoft Fabric:
- Part 1 - Overview
- Part 2 - Data Validation with Great Expectations
- Part 3 - Testing Notebooks
- Part 4 - Task Flows
- Part 5 - Observability
Microsoft Fabric First Impressions:
Decision Maker's Guide to Microsoft Fabric
and find all the rest of our content here.