Editions

The Corvus.Json.CodeGeneration library analyses JSON Schema and builds a TypeDeclaration tree that maps schema patterns to code patterns. The code generator, CLI tool, source generator, and Blazor playground all consume the same abstraction - and you can too.

A deep dive into the cross-assembly linking, PDB-based source links, TFM scanning, enrichment merging, and search indexing that power our API reference documentation pipeline.

We generate about 8,800 API reference pages from 16 libraries across two engine versions, with source links, TFM availability badges, and hand-authored enrichments - all from a single PowerShell pipeline. Here's how.

AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying on the output, this post outlines some practical principles for making AI-assisted analysis trustworthy.

Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Pydantic, and how to evaluate response quality.

Understand the augmentation step of RAG: how retrieved documents are structured into prompts, how metadata and citations improve response quality, and how to avoid common pitfalls like prompt injection.

AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying on the output, this post outlines some practical principles for making AI-assisted analysis trustworthy.

Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossible. This post describes how Calculated Tables in DAX can provide a solution

Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Pydantic, and how to evaluate response quality.

Build modern interactive web apps with ASP.NET Core, Razor, and HTMX — bridging HTMX hypermedia to Chart.js JSON APIs using HATEOAS-style stateful links.

Learn how accessibility-aware API design creates a great experience for all developers, not just those with accessibility needs.

A short rundown of why you need the ForwardedHeadersMiddleware when using Azure Container Apps to host an ASP.NET Core MVC app requiring authentication

Ray, a Year 10 student, spent a week at endjin doing work experience.

Liam joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post he looks back on his time at endjin before moving on.

Eli joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post she reflects on her first two years.

The Data Product Canvas fuses the Business Model Canvas with Data Mesh's 'data as a product' principle, combining visual strategic collaboration with product-minded data ownership.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

The Data Product Canvas has nine building blocks, best completed right-to-left starting with Audience and Actionable Insight, to keep data products purpose-driven and user-centred.

In this series of posts, we look at all the places where you can integrate Power Query as part of your data solutions. Here we look at Power BI.

In this series of posts, we look at all the places where you can integrate Power Query as part of your data solutions. Here we look at Microsoft 365.

Learn to configure AAD or MSA 2FA profiles for UI automation testing with Time-based One-Time Passwords.

Integration testing Azure Functions with Reqnroll and C#. Part 5 covers running your Corvus.Testing specs in Azure DevOps and GitHub Actions pipelines.

Integration testing Azure Functions with Reqnroll and C#. Part 4 shows how to supply or override configuration values for the functions apps under test.

Integration testing Azure Functions with Reqnroll and C#. Part 3 uses scenario and feature hooks to start functions apps and keep your BDD specs readable.

The queue-of-work pattern enables massive parallelism for API ingestion by breaking large jobs into thousands of independent work items processed by concurrent workers. This approach reduced data ingestion time for our use case from 15 hours to under 2 hours while providing automatic retry handling and fault tolerance at a fraction of the cost of traditional orchestration tools.

The queue-of-work pattern enables massive parallelism for API ingestion by breaking large jobs into thousands of independent work items processed by concurrent workers. This approach reduced data ingestion time for our use case from 15 hours to under 2 hours while providing automatic retry handling and fault tolerance at a fraction of the cost of traditional orchestration tools.

Bursty event triggers in Azure Synapse can fire the same pipeline repeatedly. A batched-trigger orchestrator collapses them into a single coordinated run.

This post describes a pattern for reliably refreshing Power BI semantic models from Azure Data Factory or Azure Synapse Pipelines.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

Serverless data architectures enable leaner data insights and operations. How do you reap the rewards while avoiding the potential pitfalls?

New Azure Synapse Analytics service offers SQL Serverless for on-demand data lake queries. We tested its potential as a Data Lake Analytics replacement.

Apply the Medallion Architecture to Excel: use the three-tab rule to separate raw data, logic, and output for cleaner, maintainable spreadsheets.

The queue-of-work pattern enables massive parallelism for API ingestion by breaking large jobs into thousands of independent work items processed by concurrent workers. This approach reduced data ingestion time for our use case from 15 hours to under 2 hours while providing automatic retry handling and fault tolerance at a fraction of the cost of traditional orchestration tools.

Polars now ships inside Microsoft Fabric by default. Here's how to use it alongside Fabric's other analytics tools and what that means for your data workflows.

Traditional cloud SLAs measure API uptime, not behavioural stability. This post talks about how silent AI model drift can quietly break your agents and the questions you might want to ask vendors.

Variable libraries in Microsoft Fabric manage environment-specific configuration. Learn where you can use them and how to set safer defaults for Dev/Test/Prod.

SharePoint isn't going away. This post compares five ways to ingest SharePoint data into Microsoft Fabric, with guidance on cost, complexity, and incremental loading.

After years away, I returned to work in the UK. Here's how remote flexibility protected my mental health and made that transition possible!

Ray, a Year 10 student, spent a week at endjin doing work experience.

Liam joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post he looks back on his time at endjin before moving on.

AI tools can produce data analysis that looks authoritative without being verifiable. Whether you're the analyst or the decision-maker relying on the output, this post outlines some practical principles for making AI-assisted analysis trustworthy.

Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossible. This post describes how Calculated Tables in DAX can provide a solution

The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating slow queries.

The final post in the Optimising DAX series: the CALCULATE trap, variables and IF.EAGER, slicer costs, and a practical approach to isolating slow queries.

Data materialisation is when the storage engine gives up on efficient processing and rebuilds the entire table. This post explains what triggers it, why it's expensive, and how to delay it.

When you execute a DAX query, two engines divide up the work. Understanding the split between the formula engine and the storage engine is key to writing performant DAX.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

Databricks SQL cold starts kill web API performance. Fix it with two-layer caching: Azure Blob Storage & IMemoryCache, using the Decorator pattern.

What exactly is a Data Lakehouse? This blog gives a general introduction to their history, functionality, and what they might mean for you!

Azure Databricks Notebooks combine live code in Python, SQL, Scala, or R with visualisations and markdown. Here's how to set them up, attach clusters, manage libraries, and integrate them into ADF/Synapse pipelines.

Learn how to access multi-select choice column choice labels from Azure Synapse Link for Dataverse using PySpark or SQL.

Learn how to access the choice labels from Azure Synapse Link for Dataverse using T-SQL through SQL Serverless and by using Spark SQL in a Synapse Notebook.

PySpark recipe for accessing choice (option set) labels, not just integer values, from Dataverse data exposed via Azure Synapse Link in your Synapse lakehouse.

Traditional cloud SLAs measure API uptime, not behavioural stability. This post talks about how silent AI model drift can quietly break your agents and the questions you might want to ask vendors.

Microsoft's new WSL Containers (wslc) promises container management on Windows without Docker Desktop. I tried it with dev containers, Aspire, and Docker Compose - here's what works, what doesn't, and whether you should switch yet.

A troubleshooting journey through Microsoft Entra ID that reveals the subtle but critical distinction between App Registration ownership and Service Principal ownership - and why it matters for least-privilege automation.

Polars now ships inside Microsoft Fabric by default. Here's how to use it alongside Fabric's other analytics tools and what that means for your data workflows.

Unlock Python Polars with this hands-on guide featuring practical code examples for data loading, cleaning, transformation, aggregation, and advanced operations that you can apply to your own data analysis projects.

Polars gets its speed from a strict type system, lazy evaluation, and automatic parallelism. Here's how each piece works under the hood.

Microsoft's new WSL Containers (wslc) promises container management on Windows without Docker Desktop. I tried it with dev containers, Aspire, and Docker Compose - here's what works, what doesn't, and whether you should switch yet.

Rx.NET 7.0 is now available, with the potential to reduce deployable application size by up to 90MB.

Databricks SQL cold starts kill web API performance. Fix it with two-layer caching: Azure Blob Storage & IMemoryCache, using the Decorator pattern.

Top-down AI strategy and bottom-up experimentation both fail alone: leading organisations combine them to drive real business results.

The Data Product Canvas fuses the Business Model Canvas with Data Mesh's 'data as a product' principle, combining visual strategic collaboration with product-minded data ownership.

See the Data Product Canvas in action with a real-world scenario. Follow along as we work through each building block to design a high-impact, feasible data product for a national garden center chain facing revenue challenges.

Wishing Azure Synapse Analytics had support for SQL notebooks? Fear not, it's easy to take advantage rich interactive notebooks for SQL Pools and SQL on Demand.

How we diagnosed unexpected allocations in AIS.NET, comparing ArrayPool<T> vs MemoryPool<T> to hit zero-allocation per-message GC targets in a .NET parsing library.

I was recently invited on to Microsoft Mechanics to talk about the new on-demand SQL Serverless offering within Azure Synapse. If you have been following along with my previous blog posts you will know that we've been hard at work applying Azure Synapse against real customer workloads. In the video I take you through the service by solving a real-world IoT problem for one of our telco customers.

Understand the generation step of RAG: how LLMs use augmented context to produce grounded responses, how to enforce structured outputs with Pydantic, and how to evaluate response quality.

Understand the augmentation step of RAG: how retrieved documents are structured into prompts, how metadata and citations improve response quality, and how to avoid common pitfalls like prompt injection.

Understand the retrieval step of RAG: Learn how database queries, keyword search, vector search, and hybrid approaches find the right information to ground your LLM responses.

Workspace topology is one of the first decisions you'll make in Microsoft Fabric, and one of the hardest to undo once you're underway. This post will help you start with the right foundations in place.

Fabric Weekly is a free weekly newsletter covering everything Microsoft Fabric. Sign up to stay on top of the latest features, updates, and community content.

Variable libraries in Microsoft Fabric manage environment-specific configuration. Learn where you can use them and how to set safer defaults for Dev/Test/Prod.

We have a wide range of computational mechanisms at our disposal, some of which emerged thanks to recent advances in AI. In this post, we look at the kinds of workloads that can take advantage of these.

Thanks in part to recent advances in AI, we have a range of computational mechanisms at our disposal. However, certain universal truths apply to all of them.

AI's current hype cycle has driven massive hardware investment. Even if AI disappoints, those hardware capabilities remain. What else can we do with them?

Rx.NET 7.0 is now available, with the potential to reduce deployable application size by up to 90MB.

Ix.NET 7.0.0 is now available. Because .NET 10.0 now includes LINQ for IAsyncEnumerable, Ix.NET's System.Linq.Async has had to step back. This post explains what has changed and why.

Rx.NET 6.1 is now available, adding three new features: DisposeWith, a TakeUntil overload that takes a CancellationToken, and ResetExceptionDispatchState.

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.

When implementing OpenChain, understanding the specification will help guide your organisation to having processes in place to review and manage open-source software

The key risks associated with open-source software, from whether you use it minimally, to using it throughout all your systems.

Row Level Security in Power BI solves one problem (who sees what) but introduces another - comparisons across the full dataset become impossible. This post describes how Calculated Tables in DAX can provide a solution

Lakehouse integration, built-in notebook resources, and collaboration features that set Microsoft Fabric notebooks apart from Jupyter and Databricks.

This post describes a pattern for reliably refreshing Power BI semantic models from Azure Data Factory or Azure Synapse Pipelines.

Benchmarking Pandas, PySpark, Polars, and DuckDB on Microsoft Fabric: in-process Python engines run 4-5x cheaper and faster than Spark for common workloads.

The queue-of-work pattern enables massive parallelism for API ingestion by breaking large jobs into thousands of independent work items processed by concurrent workers. This approach reduced data ingestion time for our use case from 15 hours to under 2 hours while providing automatic retry handling and fault tolerance at a fraction of the cost of traditional orchestration tools.

Polars now ships inside Microsoft Fabric by default. Here's how to use it alongside Fabric's other analytics tools and what that means for your data workflows.

A troubleshooting journey through Microsoft Entra ID that reveals the subtle but critical distinction between App Registration ownership and Service Principal ownership - and why it matters for least-privilege automation.

No-code/Low-code democratizes software development with little to no coding skills needed. But how do you evaluate if software DIY is the right choice for you?

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.

Snowflake is a cloud native data warehouse platform, that enabled data engineering, data science, data lakes, data sharing and data warehousing. Endjin are very excited to announce our partnership.

Integrate Snowflake into your Azure Data Factory pipelines using custom Azure Functions. Learn how to load data and run queries in our detailed step-by-step guide.

Explore the lack of a native Azure Data Factory connector for Snowflake and discover alternatives for integration between these popular platforms.

Write data back to SharePoint from Synapse Notebooks using PySpark, the Microsoft Graph API, and Service Principal auth — Drive IDs, tokens, and upload patterns.

This post describes an approach to copy files and data from SharePoint into Azure using Synapse Notebooks.

Once you've thoroughly tested your code against the local Spark service in your dev container, you'll want to run it in a real Spark cluster. This posts shows how to deploy such code to Microsoft Fabric.

Explore monetizing APIs with our guide. We offer strategies, videos, and code via Azure API Management to fast-track your business model.

Microsoft recently shot a video interviewing endjin co-founder, Howard van Rooijen, and Director of Engineering, James Broome, about how Microsoft has helped endjin grow over the past decade. This posts the top 10 ways in which Microsoft helped - from providing access to valuable software and services, to opening up sales channels, to helping to navigate the minefield of UK Financial Services regulations around cloud adoption.

In this post we discuss the characteristics of a great FinTech startup, and the importance of the API Economy to innovation in Financial Services.

Traditional cloud SLAs measure API uptime, not behavioural stability. This post talks about how silent AI model drift can quietly break your agents and the questions you might want to ask vendors.

Top-down AI strategy and bottom-up experimentation both fail alone: leading organisations combine them to drive real business results.

The Data Product Canvas fuses the Business Model Canvas with Data Mesh's 'data as a product' principle, combining visual strategic collaboration with product-minded data ownership.

In Paul Waller's final, and posthumously published blog post, he takes you through a creative walk-through of the Titanic Power BI Report he created with Barry Smart.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

Explore integrating icons, pictograms and images into Power BI in the optimal way to enhance the user experience and minimise effort required to build and maintain reports.

In Paul Waller's final, and posthumously published blog post, he takes you through a creative walk-through of the Titanic Power BI Report he created with Barry Smart.

This is follow guide to designing a mobile navigation in Power BI, covering form, icons, states, actions, with a view to enhancing report design & UI.

Explore integrating icons, pictograms and images into Power BI in the optimal way to enhance the user experience and minimise effort required to build and maintain reports.