Skip to content
· 9 min watch
Barry Smart By Barry Smart Director of Data & AI

An overview of the end-to-end demo evolving from descriptive to predictive analytics with Microsoft Fabric, using the Kaggle Titanic dataset.

About this talk

Course

In this video Barry Smart, Director of Data and AI, provides an overview of a new series providing an end-to-end demo of Microsoft Fabric focusing on a Predictive Analytics use case.

The demo will use the popular Kaggle Titanic data set to show off features across both the data engineering and data science experiences in Fabric. This will include Notebooks, Pipelines, Semantic Link, MLflow (Experiments and Models), Direct Lake mode for Power BI and of course the Lakehouse.

Barry explains some of the architecture principles that will be adopted during the demo including Medallion Architecture, DataOps practices and the Data Mesh principle of "data as a product". He explains how these patterns have been applied to shape the solution across data products that support Diagnostic Analytics and Predictive Analytics.

Chapters:

  • 00:14 Overview of Titanic data set and the features we will demo
  • 00:44 The data landscape is evolving at pace
  • 01:22 DataOps is a key focus for this demo
  • 01:51 Adopting a product mindset
  • 02:29 Goal of demo is to create a model that predicts survival on the Titanic
  • 03:02 We will use the machine learning lifecycle
  • 03:35 We deliver key stages of the machine learning lifecycle using two data products
  • 04:55 Medallion architecture for the diagnostic analytics data product
  • 06:41 MLflow enabled architecture for the predictive analytics data product
  • 07:23 How data products can be chained together to build capability
  • 07:59 What's in the next episode?

From Descriptive to Predictive Analytics with Microsoft Fabric:

Microsoft Fabric End to End Demo Series:

Microsoft Fabric First Impressions:

Decision Maker's Guide to Microsoft Fabric

and find all the rest of our content here.

About the presenter

Barry Smart

Director of Data & AI

Barry Smart

Barry has spent over 25 years in the tech industry; from developer to solution architect, business transformation manager to IT Director, and CTO of a £100m FinTech company. In 2020 Barry's passion for data and analytics led him to gain an MSc in Artificial Intelligence and Applications.