Microsoft Fabric ML Tutorial Part 4: Task Flows
A deep dive into using Task Flows to organise all of the data product artefacts in the Microsoft Fabric workspace to align with the Medallion Architecture.
About this talk
Course
In part 4 of this course Barry Smart, Director of Data and AI, walks through a demo showing how the new Task Flows feature in Microsoft Fabric can be applied. In this case, retro-fitting a suitable Task Flow to an existing project to show how it allows you to reinforce the specific architecture pattern you want to adopt and provide a means through which artefacts in a workspace can be better organised.
Barry begins the video by explaining the architecture that is being adopted in the demo and the Medallion Architecture that has been adopted. He shows how a work around has been applied by naming the artefacts in the workspace with a numerical prefix to help sort and group them according to the stages in the medallion architecture. He then demonstrates how the new Task Flow feature in Microsoft Fabric can overcome this workaround.
This forms part of an end to end demo of Microsoft Fabric that we will be providing as a series of videos over the coming weeks.
Chapters:
- 00:00 Introduction to the New Task Flow Feature
- 00:16 Recap of the Titanic Diagnostic Analytics Series
- 00:37 Understanding the Medallion Architecture
- 01:53 Exploring the Workspace and Artifacts
- 03:08 Introducing Task Flows
- 04:09 Configuring Task Flows for Titanic Analytics
- 05:10 Organizing Artifacts with Task Flows
- 06:48 Utilizing Folders for Better Organization
- 08:45 Final Thoughts and Next Steps
From Descriptive to Predictive Analytics with Microsoft Fabric:
- Part 1 - Overview
- Part 2 - Data Validation with Great Expectations
- Part 3 - Testing Notebooks
- Part 4 - Task Flows
- Part 5 - Observability
Microsoft Fabric End to End Demo Series:
- Part 1 - Lakehouse & Medallion Architecture
- Part 2 - Plan and Architect a Data Project
- Part 3 - Ingest Data
- Part 4 - Creating a shortcut to ADLS Gen2 in Fabric
- Part 5 - Local OneLake Tools
- Part 6 - Role of the Silver Layer in the Medallion Architecture
- Part 7 - Processing Bronze to Silver using Fabric Notebooks
- Part 8 - Good Notebook Development Practices
Microsoft Fabric First Impressions:
Decision Maker's Guide to Microsoft Fabric
and find all the rest of our content here.