Microsoft Fabric ML Tutorial Part 1: Course Overview
An overview of the end-to-end demo evolving from descriptive to predictive analytics with Microsoft Fabric, using the Kaggle Titanic dataset.
About this talk
Course
In this video Barry Smart, Director of Data and AI, provides an overview of a new series providing an end-to-end demo of Microsoft Fabric focusing on a Predictive Analytics use case.
The demo will use the popular Kaggle Titanic data set to show off features across both the data engineering and data science experiences in Fabric. This will include Notebooks, Pipelines, Semantic Link, MLflow (Experiments and Models), Direct Lake mode for Power BI and of course the Lakehouse.
Barry explains some of the architecture principles that will be adopted during the demo including Medallion Architecture, DataOps practices and the Data Mesh principle of "data as a product". He explains how these patterns have been applied to shape the solution across data products that support Diagnostic Analytics and Predictive Analytics.
Chapters:
- 00:14 Overview of Titanic data set and the features we will demo
- 00:44 The data landscape is evolving at pace
- 01:22 DataOps is a key focus for this demo
- 01:51 Adopting a product mindset
- 02:29 Goal of demo is to create a model that predicts survival on the Titanic
- 03:02 We will use the machine learning lifecycle
- 03:35 We deliver key stages of the machine learning lifecycle using two data products
- 04:55 Medallion architecture for the diagnostic analytics data product
- 06:41 MLflow enabled architecture for the predictive analytics data product
- 07:23 How data products can be chained together to build capability
- 07:59 What's in the next episode?
From Descriptive to Predictive Analytics with Microsoft Fabric:
- Part 1 - Overview
- Part 2 - Data Validation with Great Expectations
- Part 3 - Testing Notebooks
- Part 4 - Task Flows
- Part 5 - Observability
Microsoft Fabric End to End Demo Series:
- Part 1 - Lakehouse & Medallion Architecture
- Part 2 - Plan and Architect a Data Project
- Part 3 - Ingest Data
- Part 4 - Creating a shortcut to ADLS Gen2 in Fabric
- Part 5 - Local OneLake Tools
- Part 6 - Role of the Silver Layer in the Medallion Architecture
- Part 7 - Processing Bronze to Silver using Fabric Notebooks
- Part 8 - Good Notebook Development Practices
Microsoft Fabric First Impressions:
Decision Maker's Guide to Microsoft Fabric
and find all the rest of our content here.