Skip to content

We like to talk. We like to share our knowledge & expertise.

You can also subscribe to our YouTube and Vimeo channels

C# Source Generators Boost Productivity in the Rx.NET Repo

C# Source Generators Boost Productivity in the Rx.NET Repo

Ian Griffiths

See how source generators have been used to port over 7,000 Rx.NET unit tests to AsyncRx.NET
Data Mesh and Microsoft Fabric - a perfect fit?

Data Mesh and Microsoft Fabric - a perfect fit?

Barry Smart

Can Microsoft Fabric implement Data Mesh to enhance data value, process integration, and organizational transformation?
Microsoft Fabric Machine Learning Tutorial - Part 5 - Observability

Microsoft Fabric Machine Learning Tutorial - Part 5 - Observability

Barry Smart

Improve the observability of your data engineering processes using readily available features of Microsoft Fabric and Azure.
Microsoft Fabric Machine Learning Tutorial - Part 4 - Task Flows

Microsoft Fabric Machine Learning Tutorial - Part 4 - Task Flows

Barry Smart

A deep dive into using Task Flows to organise all of the data product artefacts in the Microsoft Fabric workspace to align with the Medallion Architecture.
Microsoft Fabric Machine Learning Tutorial - Part 3 - Testing Notebooks

Microsoft Fabric Machine Learning Tutorial - Part 3 - Testing Notebooks

Barry Smart

A deep dive into how we go about testing data wrangling logic in Microsoft Fabric, and achieve cleaner, more modular code that is easier to understand and maintain.
How to ensure quality and avoid inaccuracies in your data insights

How to ensure quality and avoid inaccuracies in your data insights

James Broome

In this session from SQLBits 2024, learn how to improve your data quality by implementing testing strategies for notebooks, data pipelines, and Power BI Reports.
Implementing OpenChain across endjin's InnerSource and Open Source estate

Implementing OpenChain across endjin's InnerSource and Open Source estate

Charlotte Gayton

Charlotte Gayton presents an overview of her industrial placement implementing OpenChain ISO/IEC 5230 and her final year project on ISO/IEC 18974.
Compelling Data Storytelling with Power BI: Global Brand Insights - 20 Years of Financial Trends

Compelling Data Storytelling with Power BI: Global Brand Insights - 20 Years of Financial Trends

Barry Smart

This walkthrough of The Global Brand Insights Report examines how design and visualisation choices make data stories with Power BI compelling.
Microsoft Fabric and Data Mesh - a perfect fit?

Microsoft Fabric and Data Mesh - a perfect fit?

Barry Smart

Unlock the full potential of Microsoft Fabric by establishing domain-orientated ownership & federated governance to deliver high impact data products.
How To Actually Make Decisions When Architecting a Data Platform

How To Actually Make Decisions When Architecting a Data Platform

Ed Freeman

Strategies and tools to help you make better technical decisions which evolve over time as your context, requirements and situational awareness change.
Compelling Data Storytelling with Power BI: Titanic Survivors

Compelling Data Storytelling with Power BI: Titanic Survivors

Paul Waller

Discover the Titanic Passenger Diagnostic Report and the creative decisions behind its design using Power BI and the Kaggle Titanic dataset.
10x Apache Spark performance improvement in Microsoft Fabric

10x Apache Spark performance improvement in Microsoft Fabric

Ian Griffiths

Learn how we achieved a 10x performance improvement when ingesting small JSON files using Apache Spark in Microsoft Fabric.
Microsoft Fabric - Good Notebook Development Practices

Microsoft Fabric - Good Notebook Development Practices

Ed Freeman

In this episode, we highlight good development practices when working with Fabric Notebooks as a primary artifact type in your code-base.
Microsoft Fabric Machine Learning Tutorial - Part 2 - Data Validation with Great Expectations

Microsoft Fabric Machine Learning Tutorial - Part 2 - Data Validation with Great Expectations

Barry Smart

A deep dive into data validation using Microsoft Fabric and Great Expectations, for a Predictive Analytics use case with the Kaggle Titanic data set.
Microsoft Fabric Machine Learning Tutorial - Part 1 - Overview of the Course

Microsoft Fabric Machine Learning Tutorial - Part 1 - Overview of the Course

Barry Smart

An overview of the end-to-end demo evolving from descriptive to predictive analytics with Microsoft Fabric, using the Kaggle Titanic dataset.
Azure Functions Deep Dive

Azure Functions Deep Dive

Ian Griffiths

Yan Cui chats to Ian Griffiths about Azure Functions, how it works and how it differs from AWS Lambda.
The Heart of Reactive Extensions for .NET

The Heart of Reactive Extensions for .NET

Ian Griffiths

Understand the Mathematical foundations that underpin the beauty of Reactive Extensions for .NET.
Microsoft Fabric - Processing Bronze to Silver using Fabric Notebooks

Microsoft Fabric - Processing Bronze to Silver using Fabric Notebooks

Ed Freeman

In this episode, we show the step-by-step process for converting data from Bronze to Silver using Fabric Notebooks.
Microsoft Fabric - Role of the Silver Layer in the Medallion Architecture

Microsoft Fabric - Role of the Silver Layer in the Medallion Architecture

Ed Freeman

The Silver layer is where we apply standardization to our source datasets in the Medallion architecture.
Modernizing Reactive Extensions for .NET

Modernizing Reactive Extensions for .NET

Ian Griffiths

Ian Griffiths discusses Rx.NET project evolution and its adaptation to .NET 8.0 changes at the .NET Conf 2023.
High Performance JSON Serialization With Code Generation on C# 11 and .NET 7.0

High Performance JSON Serialization With Code Generation on C# 11 and .NET 7.0

Ian Griffiths

Explore modern C# features for efficient JSON parsing & generation, using code generators and balancing performance with ease of use in .NET apps.
Microsoft Fabric - Local OneLake Tools

Microsoft Fabric - Local OneLake Tools

Ed Freeman

Explore OneLake data locally with OneLake File Explorer & Azure Storage Explorer. Learn to navigate, sync files, and avoid common pitfalls in this guide.
Show & Tell - A Brief Intro to Tensors & GPT with TorchSharp

Show & Tell - A Brief Intro to Tensors & GPT with TorchSharp

Ian Griffiths

Ian Griffiths explores TorchSharp for Tensor modeling, backpropagation in Neural Networks, and building a GPT from scratch.
Microsoft Fabric - Creating a OneLake Shortcut to ADLS Gen2

Microsoft Fabric - Creating a OneLake Shortcut to ADLS Gen2

Ed Freeman

Discover Microsoft Fabric Shortcuts for zero-copy data referencing across OneLake & clouds. Learn to configure Shortcuts in ADLS Gen2 & improve Lakehouse efficiency.
Decision Makers Guide to Microsoft Fabric - The Pace of Innovation

Decision Makers Guide to Microsoft Fabric - The Pace of Innovation

Ian Griffiths, Ed Freeman

Tom Peplow discusses Microsoft Fabric's disruption in insurance with endjin's Ian Griffiths & Ed Freeman, exploring open source, vendor lock-in, and innovation.
Decision Makers Guide to Microsoft Fabric - Microsoft Fabric and Generative AI

Decision Makers Guide to Microsoft Fabric - Microsoft Fabric and Generative AI

Ian Griffiths, Ed Freeman

Tom Peplow discusses AI's impact on insurance, emphasizing IT leaders' role in leveraging AI, ethical frameworks, and addressing the skills gap.
Modernizing Rx.NET

Modernizing Rx.NET

Ian Griffiths

Explore Rx.NET, a library for event-driven programming, with Maintainer & MVP Ian Griffiths as he shares the latest updates on this .NET project.
Decision Makers Guide to Microsoft Fabric - Hedging your Fabric Bet

Decision Makers Guide to Microsoft Fabric - Hedging your Fabric Bet

Ian Griffiths, Ed Freeman

Tom Peplow discusses Microsoft Fabric's potential to improve Milliman's actuarial solution, citing productivity gains but expressing IT concerns.
Microsoft Fabric - Ingesting 5GB into a Bronze Lakehouse using Data Factory

Microsoft Fabric - Ingesting 5GB into a Bronze Lakehouse using Data Factory

Ed Freeman

Ed Freeman demonstrates data ingestion from an HTTP source to OneLake using Data Factory in Microsoft Fabric, exploring Lakehouse tables, files, and pipelines.
Microsoft Fabric - Inspecting 28 Million row dataset

Microsoft Fabric - Inspecting 28 Million row dataset

Ed Freeman

Ed Freeman explores UK Land Registry data in Microsoft Fabric demo series, discussing dataset, insights, and DeltaLake-enabled UPSERT like functionality.
Microsoft Fabric - Lakehouse and Medallion Architecture

Microsoft Fabric - Lakehouse and Medallion Architecture

Ed Freeman

Explore Lakehouse & Medallion Architecture in Microsoft Fabric with Ed Freeman, discussing design patterns, data stages, and their applications.
A Tour Around Microsoft Fabric

A Tour Around Microsoft Fabric

Ed Freeman

Explore Microsoft Fabric with Ed Freeman, covering the portal, experiences, workspace, notebooks, SQL endpoints, Data Factory pipelines, and more.
Perspectives on Microsoft Fabric

Perspectives on Microsoft Fabric

Barry Smart, Ian Griffiths, Ed Freeman

Explore Microsoft Fabric, a 3rd-gen data & analytics platform, with insights from endjin's Private Preview experience in a 20-min interview.
Creating a high performance Data Team: lessons learned from the field

Creating a high performance Data Team: lessons learned from the field

Barry Smart

Explore factors for data & analytics team success with Barry Smart, using real-world examples from 25 years of high-impact project experience.
Building Large-Scale Multi-Tenant SaaS Systems with Azure Cosmos DB

Building Large-Scale Multi-Tenant SaaS Systems with Azure Cosmos DB

Ian Griffiths

Explore Azure Cosmos DB's limitless scale & security for high-performance, cost-effective storage in multi-tenant SaaS platforms with strict isolation.
An overview of Reaqtor AKA Cloud Native Rx

An overview of Reaqtor AKA Cloud Native Rx

Ian Griffiths

Endjin, a .NET Foundation Corporate Sponsor, presents Reaqtor at the .NET Foundation Summit 2023, showcasing Cloud Native Reactive Programming.
Azure Synapse Database Templates in 10 Minutes

Azure Synapse Database Templates in 10 Minutes

Barry Smart

Explore Azure Synapse Analytics' new Database Templates feature, enhancing data lake abstraction for a relational system in cloud-based data architectures.
Accessible Data Storytelling with Power BI: Design Concepts and Accessible Colours

Accessible Data Storytelling with Power BI: Design Concepts and Accessible Colours

Paul Waller

Explore global wealth & health trends with our World Bank report in Power BI. Learn about visual design, accessibility, and engagement in data storytelling.
Data Storytelling with Power BI: The World Bank World Health and Wealth Report

Data Storytelling with Power BI: The World Bank World Health and Wealth Report

Barry Smart

Explore global wealth & health trends using World Bank data in our Power BI report. Discover design concepts for engaging, accessible analytics.
Do Those Numbers Look Right?

Do Those Numbers Look Right?

James Broome

Ensure data accuracy with automated quality gates in data solutions like Power BI, Synapse Pipelines, and Spark notebooks. Learn testing techniques & tips.
Fake it 'til you make it - generating production quality test data at scale.

Fake it 'til you make it - generating production quality test data at scale.

Barry Smart

Explore open source tools & data sources for generating realistic synthetic data, enabling better product design, testing, and secure engineering practices.
How to dynamically create SQL Serverless views from Azure Synapse Pipelines

How to dynamically create SQL Serverless views from Azure Synapse Pipelines

James Broome

Discover SQL Serverless schema updates in Synapse Pipelines and dynamically manage views for precise data lake queries.
How to test Azure Synapse notebooks

How to test Azure Synapse notebooks

James Broome

Explore data with Synapse Interactive Notebooks while ensuring quality. Learn to structure notebooks for easy test integration in this insightful session.
How to define business requirements for a successful cloud data & analytics project

How to define business requirements for a successful cloud data & analytics project

James Broome

Discover how to boost data project success with an iterative, insight-driven approach, prioritizing requirements and leveraging cloud analytics platforms.
Monetize APIs with Azure API Management Using Stripe

Monetize APIs with Azure API Management Using Stripe

James Broome

Unlock digital transformation with API monetization using Azure API Management & Stripe in our demo project, featuring a step-by-step deployment guide.
Monetize APIs with Azure API Management Using Adyen

Monetize APIs with Azure API Management Using Adyen

James Broome

Learn to monetize APIs using Azure API Management & Adyen in our tutorial, featuring a demo project, revenue model, and step-by-step deployment guide.
Reaqtor - Reliable Rx at Scale for High-performance Event Processing

Reaqtor - Reliable Rx at Scale for High-performance Event Processing

Carmel Eve, Ian Griffiths

Discover Reaqtor, an open-source, scalable event processing service based on Rx, used in Microsoft's Cortana & Office 365. Learn about its unique features.
How to Start Your Career in Data Science

How to Start Your Career in Data Science

Barry Smart

Barry Smart discusses his career path, including roles as software engineer, architect, IT Director, CTO, and pursuing a Masters in AI.
How to safely reference a nullable activity output in Azure Synapse Pipelines and Azure Data Factory

How to safely reference a nullable activity output in Azure Synapse Pipelines and Azure Data Factory

Ed Freeman

Discover Azure Data Factory's null-safe operator for secure activity output referencing. Learn to handle non-existent outputs with ease in our video.
Beyond Modern Data Warehouse MVP Panel Discussion

Beyond Modern Data Warehouse MVP Panel Discussion

Howard van Rooijen

Explore how Azure Synapse, Purview, Databricks & more impact data roles, skills, and collaboration. Microsoft MVPs discuss modern data platforms & insights.
Wardley Maps: Can Maps do Good?

Wardley Maps: Can Maps do Good?

Matthew Adams

Explore the potential of maps as tools for positive change, examining their role in defining goals, understanding current situations, and enhancing strategies.
Building a secure data solution using Azure Data Lake Store

Building a secure data solution using Azure Data Lake Store

Carmel Eve

Explore Azure Data Lake Storage (ADLS) benefits, security, scalability, and monitoring. Learn to combine ADLS with serverless processing and Azure AD security.
Navigating the Bewildering Array of Data Services in Azure

Navigating the Bewildering Array of Data Services in Azure

Ian Griffiths

Explore Azure's data handling options, including databases, storage, analytics, and ETL solutions, to make informed decisions for your application needs.
Data Exploration & Experimentation with Notebooks in Azure

Data Exploration & Experimentation with Notebooks in Azure

Ian Griffiths

Microsoft invests in Notebook tech like Jupyter & .NET Interactive for data analysis, adding .NET support for Spark and Azure's Databricks integration.
Detecting Anomalies in IoT Telemetry with Azure Synapse Analytics

Detecting Anomalies in IoT Telemetry with Azure Synapse Analytics

James Broome

Explore predictive maintenance in IoT with Azure Synapse Analytics, aiding customer service through anomaly detection and end-to-end data science.
What makes a good API?

What makes a good API?

Carmel Eve, Matthew Adams

Explore API design from a consumer's perspective, focusing on simplicity and ease of understanding. Analyze popular APIs and client tooling for effective patterns.
Reactive Extensions for .NET

Reactive Extensions for .NET

Ian Griffiths

Explore Reactive Extensions (Rx) for .NET, a library for async & event-based sources. Learn how Rx aids in data processing on edge devices & Azure IoT hubs.
Serverless data prep using SQL on demand and Synapse Pipelines

Serverless data prep using SQL on demand and Synapse Pipelines

Jess Panni

Explore building serverless data prep pipelines with Azure Synapse Pipelines. Learn to use TDS endpoints, copy activity, and avoid common pitfalls.
Highlights from Sustainable Finance.LIVE: A Gathering of Real-World Expertise

Highlights from Sustainable Finance.LIVE: A Gathering of Real-World Expertise

Jess Panni, Matthew Adams

Sustainable Finance.LIVE speakers discuss Co-Creation Workshops, ESG portfolio building, and data management challenges in investment and asset management.
Azure Synapse - On-Demand Serverless Compute and Querying

Azure Synapse - On-Demand Serverless Compute and Querying

Jess Panni

In this episode of Microsoft Mechanics, endjin shares how it uses Azure Synapse for serverless compute and querying to tackle big data challenges across various industries.
Custom C# Spark Jobs in Azure Synapse

Custom C# Spark Jobs in Azure Synapse

Ian Griffiths

Learn to run a C# custom Spark job in Azure Synapse: create a workspace, add a Spark pool, configure storage, write code in Visual Studio Code, and execute.
Custom Scala Spark Jobs in Azure Synapse

Custom Scala Spark Jobs in Azure Synapse

Ian Griffiths

Learn to run a Scala custom Spark job in Azure Synapse: create a workspace, add a Spark pool, configure storage, write code in VS Code, and execute.
Uniting the World of Data with ESG Goals

Uniting the World of Data with ESG Goals

Matthew Adams

Matthew Adams discusses uniting data science & corporate ESG at SustainableFinance.Live for achieving sustainable goals.
A View From: Reporting and Data to Build an ESG Portfolio

A View From: Reporting and Data to Build an ESG Portfolio

Jess Panni

Jess Panni leads a session on ESG Portfolio building, discussing data management challenges and opportunities for passive investing in institutional assets.
CNAB packages to deploy applications from Azure to anywhere at all

CNAB packages to deploy applications from Azure to anywhere at all

Mike Evans-Larah

Explore CNAB, a spec for bundling & managing cloud-native apps. Learn about Azure CNAB Quickstart Library & create a Hello World example with experts.
5 ways to prepare for public speaking

5 ways to prepare for public speaking

Carmel Eve

Public speaking tips from Carmel Eve, gained from NDC & Azure Oxford events. Learn preparation strategies to conquer nerves & deliver effectively.
Paths into technology

Paths into technology

Carmel Eve

Carmel Eve shares her journey from a science background to a tech career, highlighting how diverse paths can lead to success in the industry.
Managing mental health and remote working

Managing mental health and remote working

Carmel Eve

Since 2017, endjin embraces remote work, offering work-life balance. Carmel shares tips to tackle mental health challenges in a remote work environment.
C# 8.0 Nullable Reference in Practice

C# 8.0 Nullable Reference in Practice

Ian Griffiths

Explore C# 8.0's non-nullable references feature with Ian Griffiths, as he shares endjin's experience and strategies for migrating existing codebases.
Introduction to Azure CNAB Quickstarts

Introduction to Azure CNAB Quickstarts

Mike Evans-Larah

Explore the Azure CNAB Quickstart Library for bundling, installing, and managing cloud-native apps. Learn to create and deploy bundles across various platforms.
Machine Learning and Azure Against Illegal Fishing

Machine Learning and Azure Against Illegal Fishing

Carmel Eve, Jess Panni

Explore cloud-first architecture for tackling illegal fishing using Azure, serverless tech & data analytics. Learn design principles & cost benefits.
The art of Wardley Mapping Sustainable business goals

The art of Wardley Mapping Sustainable business goals

Matthew Adams

Explore how endjin uses Wardley Mapping to align sustainable business goals with tech strategy, focusing on data's crucial role in sustainable finance.
Combatting illegal fishing with Machine Learning and Azure

Combatting illegal fishing with Machine Learning and Azure

Carmel Eve, Jess Panni

Explore a cloud-first, serverless architecture for detecting illegal fishing using Azure, ML, and geo-spatial models. Learn design principles & cost benefits.
A step-by-step customer propensity experiment with Azure Machine Learning Studio

A step-by-step customer propensity experiment with Azure Machine Learning Studio

Ed Freeman

Explore a customer propensity experiment in Azure Machine Learning Studio, prioritizing e-commerce clients likely to purchase a new service.
Wardley Maps - Explaining how OceanMind use Microsoft Azure & AI to combat Illegal Fishing

Wardley Maps - Explaining how OceanMind use Microsoft Azure & AI to combat Illegal Fishing

Jess Panni

OceanMind uses AI to combat illegal fishing and needed a digital transformation. Learn how Wardley Mapping guided their successful migration to Azure.
Real world Data Science in Industry

Real world Data Science in Industry

Jess Panni

In this podcast we explore Azure in real-world ML projects, using Machine Learning Studio for insights, and discusses data science coexisting with agile teams.
Unlocking Digital Transformation with Azure API Management

Unlocking Digital Transformation with Azure API Management

James Broome

Explore digital transformation through APIs, assess your organization's API maturity, and learn strategies for success in this 50-minute Tech Briefing.
The 100 Year Start-up - Embracing Disruption in Financial Services

The 100 Year Start-up - Embracing Disruption in Financial Services

Matthew Adams

Hymans Robertson CTO Barry Smart & endjin's Matthew Adams discuss Hymans shift to FinTech, cloud, and API-driven innovation in actuarial consultancy.