A Brief Introduction to Streamlit Development
Streamlit is a powerful Python library for creating data visualizations with minimal code. Learn how to get started.
Talks
We like to talk. We like to share our knowledge & expertise.
You can also subscribe to our YouTube and Vimeo channels
Simplify your Streamlit Python Development Experience with Dev Containers
Tired of the headaches that come with managing Python environments? Discover how Dev Containers can simplify your local development experience.
An Introduction to Corvus.JsonSchema Code Generator for .NET
Learn how to use Corvus.JsonSchema, an open-source JSON schema validation and serialization library for .NET
What's up with Half.MaxValue in .NET?
A deep dive into the peculiar behaviour of the half-precision floating point type in .NET.
C# Source Generators Boost Productivity in the Rx.NET Repo
See how source generators have been used to port over 7,000 Rx.NET unit tests to AsyncRx.NET
Data Mesh and Microsoft Fabric - a perfect fit?
Can Microsoft Fabric implement Data Mesh to enhance data value, process integration, and organizational transformation?
Microsoft Fabric Machine Learning Tutorial - Part 5 - Observability
Improve the observability of your data engineering processes using readily available features of Microsoft Fabric and Azure.
Microsoft Fabric Machine Learning Tutorial - Part 4 - Task Flows
A deep dive into using Task Flows to organise all of the data product artefacts in the Microsoft Fabric workspace to align with the Medallion Architecture.
Microsoft Fabric Machine Learning Tutorial - Part 3 - Testing Notebooks
A deep dive into how we go about testing data wrangling logic in Microsoft Fabric, and achieve cleaner, more modular code that is easier to understand and maintain.
How to ensure quality and avoid inaccuracies in your data insights
In this session from SQLBits 2024, learn how to improve your data quality by implementing testing strategies for notebooks, data pipelines, and Power BI Reports.
Implementing OpenChain across endjin's InnerSource and Open Source estate
Charlotte Gayton presents an overview of her industrial placement implementing OpenChain ISO/IEC 5230 and her final year project on ISO/IEC 18974.
Compelling Data Storytelling with Power BI: Global Brand Insights - 20 Years of Financial Trends
This walkthrough of The Global Brand Insights Report examines how design and visualisation choices make data stories with Power BI compelling.
Microsoft Fabric and Data Mesh - a perfect fit?
Unlock the full potential of Microsoft Fabric by establishing domain-orientated ownership & federated governance to deliver high impact data products.
How To Actually Make Decisions When Architecting a Data Platform
Strategies and tools to help you make better technical decisions which evolve over time as your context, requirements and situational awareness change.
Compelling Data Storytelling with Power BI: Titanic Survivors
Discover the Titanic Passenger Diagnostic Report and the creative decisions behind its design using Power BI and the Kaggle Titanic dataset.
10x Apache Spark performance improvement in Microsoft Fabric
Learn how we achieved a 10x performance improvement when ingesting small JSON files using Apache Spark in Microsoft Fabric.
Microsoft Fabric - Good Notebook Development Practices
In this episode, we highlight good development practices when working with Fabric Notebooks as a primary artifact type in your code-base.
Microsoft Fabric Machine Learning Tutorial - Part 2 - Data Validation with Great Expectations
A deep dive into data validation using Microsoft Fabric and Great Expectations, for a Predictive Analytics use case with the Kaggle Titanic data set.
Microsoft Fabric Machine Learning Tutorial - Part 1 - Overview of the Course
An overview of the end-to-end demo evolving from descriptive to predictive analytics with Microsoft Fabric, using the Kaggle Titanic dataset.
Azure Functions Deep Dive
Yan Cui chats to Ian Griffiths about Azure Functions, how it works and how it differs from AWS Lambda.
The Heart of Reactive Extensions for .NET
Understand the Mathematical foundations that underpin the beauty of Reactive Extensions for .NET.
Microsoft Fabric - Processing Bronze to Silver using Fabric Notebooks
In this episode, we show the step-by-step process for converting data from Bronze to Silver using Fabric Notebooks.
Microsoft Fabric - Role of the Silver Layer in the Medallion Architecture
The Silver layer is where we apply standardization to our source datasets in the Medallion architecture.
Modernizing Reactive Extensions for .NET
Ian Griffiths discusses Rx.NET project evolution and its adaptation to .NET 8.0 changes at the .NET Conf 2023.
High Performance JSON Serialization With Code Generation on C# 11 and .NET 7.0
Explore modern C# features for efficient JSON parsing & generation, using code generators and balancing performance with ease of use in .NET apps.
Microsoft Fabric - Local OneLake Tools
Explore OneLake data locally with OneLake File Explorer & Azure Storage Explorer. Learn to navigate, sync files, and avoid common pitfalls in this guide.
Show & Tell - A Brief Intro to Tensors & GPT with TorchSharp
Ian Griffiths explores TorchSharp for Tensor modeling, backpropagation in Neural Networks, and building a GPT from scratch.
Microsoft Fabric - Creating a OneLake Shortcut to ADLS Gen2
Discover Microsoft Fabric Shortcuts for zero-copy data referencing across OneLake & clouds. Learn to configure Shortcuts in ADLS Gen2 & improve Lakehouse efficiency.
Decision Makers Guide to Microsoft Fabric - The Pace of Innovation
Tom Peplow discusses Microsoft Fabric's disruption in insurance with endjin's Ian Griffiths & Ed Freeman, exploring open source, vendor lock-in, and innovation.
Decision Makers Guide to Microsoft Fabric - Microsoft Fabric and Generative AI
Tom Peplow discusses AI's impact on insurance, emphasizing IT leaders' role in leveraging AI, ethical frameworks, and addressing the skills gap.
Modernizing Rx.NET
Explore Rx.NET, a library for event-driven programming, with Maintainer & MVP Ian Griffiths as he shares the latest updates on this .NET project.
Decision Makers Guide to Microsoft Fabric - Hedging your Fabric Bet
Tom Peplow discusses Microsoft Fabric's potential to improve Milliman's actuarial solution, citing productivity gains but expressing IT concerns.
Microsoft Fabric - Ingesting 5GB into a Bronze Lakehouse using Data Factory
Ed Freeman demonstrates data ingestion from an HTTP source to OneLake using Data Factory in Microsoft Fabric, exploring Lakehouse tables, files, and pipelines.
Microsoft Fabric - Inspecting 28 Million row dataset
Ed Freeman explores UK Land Registry data in Microsoft Fabric demo series, discussing dataset, insights, and DeltaLake-enabled UPSERT like functionality.
Microsoft Fabric - Lakehouse and Medallion Architecture
Explore Lakehouse & Medallion Architecture in Microsoft Fabric with Ed Freeman, discussing design patterns, data stages, and their applications.
A Tour Around Microsoft Fabric
Explore Microsoft Fabric with Ed Freeman, covering the portal, experiences, workspace, notebooks, SQL endpoints, Data Factory pipelines, and more.
Perspectives on Microsoft Fabric
Explore Microsoft Fabric, a 3rd-gen data & analytics platform, with insights from endjin's Private Preview experience in a 20-min interview.
Creating a high performance Data Team: lessons learned from the field
Explore factors for data & analytics team success with Barry Smart, using real-world examples from 25 years of high-impact project experience.
Building Large-Scale Multi-Tenant SaaS Systems with Azure Cosmos DB
Explore Azure Cosmos DB's limitless scale & security for high-performance, cost-effective storage in multi-tenant SaaS platforms with strict isolation.
An overview of Reaqtor AKA Cloud Native Rx
Endjin, a .NET Foundation Corporate Sponsor, presents Reaqtor at the .NET Foundation Summit 2023, showcasing Cloud Native Reactive Programming.
Azure Synapse Database Templates in 10 Minutes
Explore Azure Synapse Analytics' new Database Templates feature, enhancing data lake abstraction for a relational system in cloud-based data architectures.
Data Storytelling with Power BI: The World Bank World Health and Wealth Report
Explore global wealth & health trends using World Bank data in our Power BI report. Discover design concepts for engaging, accessible analytics.
Accessible Data Storytelling with Power BI: Design Concepts and Accessible Colours
Explore global wealth & health trends with our World Bank report in Power BI. Learn about visual design, accessibility, and engagement in data storytelling.
Do Those Numbers Look Right?
Ensure data accuracy with automated quality gates in data solutions like Power BI, Synapse Pipelines, and Spark notebooks. Learn testing techniques & tips.
Fake it 'til you make it - generating production quality test data at scale.
Explore open source tools & data sources for generating realistic synthetic data, enabling better product design, testing, and secure engineering practices.
How to dynamically create SQL Serverless views from Azure Synapse Pipelines
Discover SQL Serverless schema updates in Synapse Pipelines and dynamically manage views for precise data lake queries.
How to test Azure Synapse notebooks
Explore data with Synapse Interactive Notebooks while ensuring quality. Learn to structure notebooks for easy test integration in this insightful session.
How to define business requirements for a successful cloud data & analytics project
Discover how to boost data project success with an iterative, insight-driven approach, prioritizing requirements and leveraging cloud analytics platforms.
Monetize APIs with Azure API Management Using Adyen
Learn to monetize APIs using Azure API Management & Adyen in our tutorial, featuring a demo project, revenue model, and step-by-step deployment guide.
Monetize APIs with Azure API Management Using Stripe
Unlock digital transformation with API monetization using Azure API Management & Stripe in our demo project, featuring a step-by-step deployment guide.
Reaqtor - Reliable Rx at Scale for High-performance Event Processing
Discover Reaqtor, an open-source, scalable event processing service based on Rx, used in Microsoft's Cortana & Office 365. Learn about its unique features.
How to Start Your Career in Data Science
Barry Smart discusses his career path, including roles as software engineer, architect, IT Director, CTO, and pursuing a Masters in AI.
How to safely reference a nullable activity output in Azure Synapse Pipelines and Azure Data Factory
Discover Azure Data Factory's null-safe operator for secure activity output referencing. Learn to handle non-existent outputs with ease in our video.
Beyond Modern Data Warehouse MVP Panel Discussion
Explore how Azure Synapse, Purview, Databricks & more impact data roles, skills, and collaboration. Microsoft MVPs discuss modern data platforms & insights.
Wardley Maps: Can Maps do Good?
Explore the potential of maps as tools for positive change, examining their role in defining goals, understanding current situations, and enhancing strategies.
Building a secure data solution using Azure Data Lake Store
Explore Azure Data Lake Storage (ADLS) benefits, security, scalability, and monitoring. Learn to combine ADLS with serverless processing and Azure AD security.
Navigating the Bewildering Array of Data Services in Azure
Explore Azure's data handling options, including databases, storage, analytics, and ETL solutions, to make informed decisions for your application needs.
Data Exploration & Experimentation with Notebooks in Azure
Microsoft invests in Notebook tech like Jupyter & .NET Interactive for data analysis, adding .NET support for Spark and Azure's Databricks integration.
Detecting Anomalies in IoT Telemetry with Azure Synapse Analytics
Explore predictive maintenance in IoT with Azure Synapse Analytics, aiding customer service through anomaly detection and end-to-end data science.
What makes a good API?
Explore API design from a consumer's perspective, focusing on simplicity and ease of understanding. Analyze popular APIs and client tooling for effective patterns.
Reactive Extensions for .NET
Explore Reactive Extensions (Rx) for .NET, a library for async & event-based sources. Learn how Rx aids in data processing on edge devices & Azure IoT hubs.
Serverless data prep using SQL on demand and Synapse Pipelines
Explore building serverless data prep pipelines with Azure Synapse Pipelines. Learn to use TDS endpoints, copy activity, and avoid common pitfalls.
Highlights from Sustainable Finance.LIVE: A Gathering of Real-World Expertise
Sustainable Finance.LIVE speakers discuss Co-Creation Workshops, ESG portfolio building, and data management challenges in investment and asset management.
Azure Synapse - On-Demand Serverless Compute and Querying
In this episode of Microsoft Mechanics, endjin shares how it uses Azure Synapse for serverless compute and querying to tackle big data challenges across various industries.
Custom Scala Spark Jobs in Azure Synapse
Learn to run a Scala custom Spark job in Azure Synapse: create a workspace, add a Spark pool, configure storage, write code in VS Code, and execute.
Custom C# Spark Jobs in Azure Synapse
Learn to run a C# custom Spark job in Azure Synapse: create a workspace, add a Spark pool, configure storage, write code in Visual Studio Code, and execute.
Uniting the World of Data with ESG Goals
Matthew Adams discusses uniting data science & corporate ESG at SustainableFinance.Live for achieving sustainable goals.
A View From: Reporting and Data to Build an ESG Portfolio
Jess Panni leads a session on ESG Portfolio building, discussing data management challenges and opportunities for passive investing in institutional assets.
5 ways to prepare for public speaking
Public speaking tips from Carmel Eve, gained from NDC & Azure Oxford events. Learn preparation strategies to conquer nerves & deliver effectively.
CNAB packages to deploy applications from Azure to anywhere at all
Explore CNAB, a spec for bundling & managing cloud-native apps. Learn about Azure CNAB Quickstart Library & create a Hello World example with experts.
Paths into technology
Carmel Eve shares her journey from a science background to a tech career, highlighting how diverse paths can lead to success in the industry.
Managing mental health and remote working
Since 2017, endjin embraces remote work, offering work-life balance. Carmel shares tips to tackle mental health challenges in a remote work environment.
C# 8.0 Nullable Reference in Practice
Explore C# 8.0's non-nullable references feature with Ian Griffiths, as he shares endjin's experience and strategies for migrating existing codebases.
Introduction to Azure CNAB Quickstarts
Explore the Azure CNAB Quickstart Library for bundling, installing, and managing cloud-native apps. Learn to create and deploy bundles across various platforms.
Machine Learning and Azure Against Illegal Fishing
Explore cloud-first architecture for tackling illegal fishing using Azure, serverless tech & data analytics. Learn design principles & cost benefits.
The art of Wardley Mapping Sustainable business goals
Explore how endjin uses Wardley Mapping to align sustainable business goals with tech strategy, focusing on data's crucial role in sustainable finance.
Combatting illegal fishing with Machine Learning and Azure
Explore a cloud-first, serverless architecture for detecting illegal fishing using Azure, ML, and geo-spatial models. Learn design principles & cost benefits.
A step-by-step customer propensity experiment with Azure Machine Learning Studio
Explore a customer propensity experiment in Azure Machine Learning Studio, prioritizing e-commerce clients likely to purchase a new service.
Wardley Maps - Explaining how OceanMind use Microsoft Azure & AI to combat Illegal Fishing
OceanMind uses AI to combat illegal fishing and needed a digital transformation. Learn how Wardley Mapping guided their successful migration to Azure.
Real world Data Science in Industry
In this podcast we explore Azure in real-world ML projects, using Machine Learning Studio for insights, and discusses data science coexisting with agile teams.
Unlocking Digital Transformation with Azure API Management
Explore digital transformation through APIs, assess your organization's API maturity, and learn strategies for success in this 50-minute Tech Briefing.
The 100 Year Start-up - Embracing Disruption in Financial Services
Hymans Robertson CTO Barry Smart & endjin's Matthew Adams discuss Hymans shift to FinTech, cloud, and API-driven innovation in actuarial consultancy.