Browse our archives by topic…
Blog

The Data Product Canvas: Stop Building Data Products That Fail
Turn data initiatives into business success stories with the Data Product Canvas. This practical framework helps teams design data products that deliver real value, avoid common pitfalls, and align with business objectives.

Building data quality into Microsoft Fabric
Data quality issues are one of the biggest silent killers of analytics initiatives. This post explores how to build data quality into Microsoft Fabric from the ground up.

Top Features of Notebooks in Microsoft Fabric
Discover the top key features of notebooks in Microsoft Fabric.

How .NET 10.0 boosted JSON Schema performance by 18%
We benchmarked endjin's JSON Schema library on .NET 10.0 and saw large performance gains.

Big Data London 2025
AI agents dominated Big Data LDN 2025, but the real story wasn't the technology, it was which organisations could actually deploy it successfully. After five years tracking industry evolution through this event, one pattern emerged clearly: the winners had built their foundations first. For CTOs making platform decisions now, the strategic imperative isn't choosing between innovation and governance; it's recognizing that governance enables innovation at scale.

FabCon Vienna 2025: Day 3
FabCon is a conference dedicated to everything Microsoft Fabric. Day 3's sessions included migration, Databricks, Spark optimisation, and more.

FabCon Vienna 2025: Day 2
FabCon is a conference dedicated to everything Microsoft Fabric. Day 2 featured deep dives into OneLake, Maps in Fabric, and multi-agent AI systems.

Rx.NET v6.1 Now Available
Rx.NET 6.1 is now available, adding some useful new features.

Batch Processing Triggered Pipeline Runs in Azure Synapse
This post describes a pattern for batch processing triggered pipeline runs in Azure Synapse

Reliably refreshing a Semantic Model from Azure Data Factory or Synapse Pipelines
This post describes a pattern for reliably refreshing Power BI semantic models from Azure Data Factory or Azure Synapse Pipelines.

Reliably refreshing a Semantic Model from Microsoft Fabric Pipelines
This post describes a pattern for reliably refreshing Power BI semantic models from Microsoft Fabric Pipelines.

FabCon Vienna 2025: Day 1
FabCon is a conference dedicated to everything Microsoft Fabric. Day 1 was mostly focused around the hundreds of new feature announcements.

Supercharge Your Dev Containers on Windows
Running VS Code Dev Containers on Windows? Clone repos inside WSL filesystem to eliminate I/O bottlenecks and boost performance dramatically.

Guest Blog Post: Hello World! I'm Ray and I'm doing work experience.
Ray, a Year 10 student, spent a week at endjin doing work experience.

Writing structured data to SharePoint from Synapse Notebooks
This post describes an approach to write data to SharePoint from Synapse Notebooks.

Composition, Polymorphism, and Pattern Matching with JSON Schema and .NET
We discover how composition in JSON Schema is a natural fit for .NET with Corvus.JsonSchema.

Reading structured data from SharePoint in Synapse Notebooks
This post describes an approach to copy files and data from SharePoint into Azure using Synapse Notebooks.

DuckLake in Perspective: Advanced Features and Future Implications
Explore DuckLake's advanced capabilities including built-in encryption, sophisticated conflict resolution, and the strategic implications for future data architecture. Understand how DuckLake enables new business models and positions itself against established lakehouse formats.

DuckLake in Practice: Hands-On Tutorial and Core Features
Get hands-on with DuckLake through a comprehensive tutorial covering installation, basic operations, file organization, snapshots, and time travel functionality. Learn how DuckLake's database-backed metadata management works in practice.

Introducing DuckLake: Lakehouse Architecture Reimagined for the Modern Era
DuckDB Labs introduces DuckLake, a revolutionary approach to lakehouse architecture that solves fundamental problems with existing formats by bringing database principles back to data lake metadata management.

Reading structured data from SharePoint in Synapse Pipelines
This post describes an approach to copy files and data from SharePoint into Azure using Synapse Pipelines.

Synapse & Service Principal SharePoint Integration
The interactive notebook shared in this post defines the process of granting Service Principals (inc. Synapse managed identities) access to SharePoint sites.

.NET Aspire: SQL persistence
.NET Aspire can create new local instances of services such as SQL Server from scratch each time you run. While this guarantees repeatability and isolation, it can be time consuming, so this post explores alternatives.

.NET Aspire: using SqlConnection in integration tests
.NET Aspire can create all of the resources an integration test required, but the test will often need direct access to the same SQL database as the code under test. This post shows how to do that.

.NET Aspire SQL Server integration tests and local development
.NET Aspire can create local services such as a SQL Server to stand in for cloud resources under local development and testing. This post shows how to ensure such a database is suitably initialized.