Editions

We benchmarked endjin's JSON Schema library on .NET 10.0 and saw large performance gains.

Rx.NET 6.1 is now available, adding some useful new features.

We discover how composition in JSON Schema is a natural fit for .NET with Corvus.JsonSchema.

Explore the theoretical foundations of the Data Product Canvas. Understand how the Business Model Canvas and Data Mesh principles combine to create a powerful framework for designing successful data products.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Explore the nine building blocks that make up the Data Product Canvas. Learn how to approach each component to design data products that deliver real value and avoid common pitfalls.

Ray, a Year 10 student, spent a week at endjin doing work experience.

Liam joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post he looks back on his time at endjin before moving on.

Eli joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post she reflects on her first two years.

Explore the theoretical foundations of the Data Product Canvas. Understand how the Business Model Canvas and Data Mesh principles combine to create a powerful framework for designing successful data products.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Explore the nine building blocks that make up the Data Product Canvas. Learn how to approach each component to design data products that deliver real value and avoid common pitfalls.

In this series of posts, we look at all the places where you can integrate Power Query as part of your data solutions. Here we look at Power BI.

In this series of posts, we look at all the places where you can integrate Power Query as part of your data solutions. Here we look at Microsoft 365.

Learn to configure AAD or MSA 2FA profiles for UI automation testing with Time-based One-Time Passwords.

This post describes an approach to write data to SharePoint from Synapse Notebooks.

This post describes an approach to copy files and data from SharePoint into Azure using Synapse Notebooks.

This post describes an approach to copy files and data from SharePoint into Azure using Synapse Pipelines.

This post describes a pattern for batch processing triggered pipeline runs in Azure Synapse

This post describes a pattern for reliably refreshing Power BI semantic models from Azure Data Factory or Azure Synapse Pipelines.

This post describes an approach to write data to SharePoint from Synapse Notebooks.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

Serverless data architectures enable leaner data insights and operations. How do you reap the rewards while avoiding the potential pitfalls?

New Azure Synapse Analytics service offers SQL Serverless for on-demand data lake queries. We tested its potential as a Data Lake Analytics replacement.

Discover the top key features of notebooks in Microsoft Fabric.

Explore DuckLake's advanced capabilities including built-in encryption, sophisticated conflict resolution, and the strategic implications for future data architecture. Understand how DuckLake enables new business models and positions itself against established lakehouse formats.

Get hands-on with DuckLake through a comprehensive tutorial covering installation, basic operations, file organization, snapshots, and time travel functionality. Learn how DuckLake's database-backed metadata management works in practice.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 3's sessions included migration, Databricks, Spark optimisation, and more.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 2 featured deep dives into OneLake, Maps in Fabric, and multi-agent AI systems.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 1 was mostly focused around the hundreds of new feature announcements.

Ray, a Year 10 student, spent a week at endjin doing work experience.

Liam joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post he looks back on his time at endjin before moving on.

Women of Silicon Roundabout is the UK's largest women in tech event. Day two topics included: green tech, burnout, and Python!

Explore the theoretical foundations of the Data Product Canvas. Understand how the Business Model Canvas and Data Mesh principles combine to create a powerful framework for designing successful data products.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Explore the nine building blocks that make up the Data Product Canvas. Learn how to approach each component to design data products that deliver real value and avoid common pitfalls.

Data quality issues are one of the biggest silent killers of analytics initiatives. This post explores how to build data quality into Microsoft Fabric from the ground up.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 3's sessions included migration, Databricks, Spark optimisation, and more.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 2 featured deep dives into OneLake, Maps in Fabric, and multi-agent AI systems.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

Microsoft Fabric unifies data & analytics, building on Azure Synapse Analytics for improved data-level interoperability. Explore its offerings & pros/cons.

Explore how to implement source control in Databricks notebooks, promoting software engineering best practices.

Learn how to access multi-select choice column choice labels from Azure Synapse Link for Dataverse using PySpark or SQL.

Learn how to access the choice labels from Azure Synapse Link for Dataverse using T-SQL through SQL Serverless and by using Spark SQL in a Synapse Notebook.

Learn how to access the choice labels from Azure Synapse Link for Dataverse using PySpark.

Running VS Code Dev Containers on Windows? Clone repos inside WSL filesystem to eliminate I/O bottlenecks and boost performance dramatically.

Polyglot Notebooks' PowerShell support enhances IT Ops with robust, repeatable processes via 'executable documentation'.

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.

Data quality issues are one of the biggest silent killers of analytics initiatives. This post explores how to build data quality into Microsoft Fabric from the ground up.

Rx.NET 6.1 is now available, adding some useful new features.

Running VS Code Dev Containers on Windows? Clone repos inside WSL filesystem to eliminate I/O bottlenecks and boost performance dramatically.

Explore the theoretical foundations of the Data Product Canvas. Understand how the Business Model Canvas and Data Mesh principles combine to create a powerful framework for designing successful data products.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Explore the nine building blocks that make up the Data Product Canvas. Learn how to approach each component to design data products that deliver real value and avoid common pitfalls.

Some of my thoughts inspired whilst helping out on the farm over the weekend. What is the future of work given the increasing presence of machines in our day to day lives? In which situations can AI deliver greatest value? How can we ease the stress of digital transformation on people who are impacted by it?

Wishing Azure Synapse Analytics had support for SQL notebooks? Fear not, it's easy to take advantage rich interactive notebooks for SQL Pools and SQL on Demand.

Tracking down unexpected allocations in a high-performance .NET parsing library.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

This is a summary of the sessions I attended at SQLbits 2024 - Europe's largest expert led data conference. This year SQLBits was hosted at Farnborough IECC, Hampshire.

This is a summary of the sessions I attended at SQLbits 2023 in Newport Wales, which is Europe's largest expert led data conference.

Data quality issues are one of the biggest silent killers of analytics initiatives. This post explores how to build data quality into Microsoft Fabric from the ground up.

Discover the top key features of notebooks in Microsoft Fabric.

FabCon is a conference dedicated to everything Microsoft Fabric. Day 3's sessions included migration, Databricks, Spark optimisation, and more.

We have a wide range of computational mechanisms at our disposal, some of which emerged thanks to recent advances in AI. In this post, we look at the kinds of workloads that can take advantage of these.

Thanks in part to recent advances in AI, we have a range of computational mechanisms at our disposal. However, certain universal truths apply to all of them.

Recent huge investment in AI has changed the modern computational landscape. Whatever the value of recent AI developments ultimately proves to be, we have some new hardware capabilities as a side effect. What else do these enable?

Rx.NET 6.1 is now available, adding some useful new features.

Ray, a Year 10 student, spent a week at endjin doing work experience.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.

When implementing OpenChain, understanding the specification will help guide your organisation to having processes in place to review and manage open-source software

The key risks associated with open-source software, from whether you use it minimally, to using it throughout all your systems.

Discover the top key features of notebooks in Microsoft Fabric.

This post describes a pattern for reliably refreshing Power BI semantic models from Azure Data Factory or Azure Synapse Pipelines.

This post describes a pattern for reliably refreshing Power BI semantic models from Microsoft Fabric Pipelines.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

This blog explores how to implement robust validation strategies within the medallion architecture using Pandera, helping you catch issues early and maintain clean, trustworthy data.

Learn how to configure VS Code to enable stepping into external code when debugging a Python Behave test

No-code/Low-code democratizes software development with little to no coding skills needed. But how do you evaluate if software DIY is the right choice for you?

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.

When implementing OpenChain, understanding the specification will help guide your organisation to having processes in place to review and manage open-source software

This post describes an approach to write data to SharePoint from Synapse Notebooks.

This post describes an approach to copy files and data from SharePoint into Azure using Synapse Notebooks.

Once you've thoroughly tested your code against the local Spark service in your dev container, you'll want to run it in a real Spark cluster. This posts shows how to deploy such code to Microsoft Fabric.

Explore monetizing APIs with our guide. We offer strategies, videos, and code via Azure API Management to fast-track your business model.

Microsoft recently shot a video interviewing endjin co-founder, Howard van Rooijen, and Director of Engineering, James Broome, about how Microsoft has helped endjin grow over the past decade. This posts the top 10 ways in which Microsoft helped - from providing access to valuable software and services, to opening up sales channels, to helping to navigate the minefield of UK Financial Services regulations around cloud adoption.

In this post we discuss the characteristics of a great FinTech startup, and the importance of the API Economy to innovation in Financial Services.

Explore the theoretical foundations of the Data Product Canvas. Understand how the Business Model Canvas and Data Mesh principles combine to create a powerful framework for designing successful data products.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Explore the nine building blocks that make up the Data Product Canvas. Learn how to approach each component to design data products that deliver real value and avoid common pitfalls.

In Paul Waller's final, and posthumously published blog post, he takes you through a creative walk-through of the Titanic Power BI Report he created with Barry Smart.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

Explore integrating icons, pictograms and images into Power BI in the optimal way to enhance the user experience and minimise effort required to build and maintain reports.

In Paul Waller's final, and posthumously published blog post, he takes you through a creative walk-through of the Titanic Power BI Report he created with Barry Smart.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

Explore integrating icons, pictograms and images into Power BI in the optimal way to enhance the user experience and minimise effort required to build and maintain reports.