Blog

Spark doesn't always interpret JSON how we'd like. For example, if each key/value pair in a JSON object is conceptually one item, Spark won't give you a row per item by default. This article shows how to nudge Spark in the right direction.

This post examines .NET's native support for iterators: IEnumerator<T>, IEnumerable<T>, and IAsyncEnumerable<T>.

This guide captures the essential points that leaders should consider when setting up a new data team.

Use Reactive Extensions for .NET to transform FileSystemWatcher events into a powerful and easy-to-use event stream to deal with file system idiosyncrasies.

Common patterns with C# and JSON Schema - using conversions to map automatically between arbitrary types.

Common patterns with C# and JSON Schema - using unevaluatedProperties to create maps of strings to strongly typed values.

Common patterns with C# and JSON Schema - using oneOf to create numeric enumerations and dispatch with pattern matching.

Common patterns with C# and JSON Schema - using enum to create enumerations and dispatch with pattern matching.

Common patterns with C# and JSON Schema - using const to create discriminator properties for polymorphic types.

Common patterns with C# and JSON Schema - using oneOf for discriminated unions and pattern matching.

Common patterns with C# and JSON Schema - composing interface-like mix-in types with allOf.

Common patterns with C# and JSON Schema - creating tuples with prefixItems and unevaluatedItems.

Common patterns with C# and JSON Schema - Working with tensors by converting to and from numeric spans.

Common patterns with C# and JSON Schema - Creating an array of higher rank using nested items array schema, minItems and maxItems.

Common patterns with C# and JSON Schema - Creating a strongly typed array with items, minItems and maxItems.

Common patterns with C# and JSON Schema - constraining a base type.

Common patterns with C# and JSON Schema - extending-a-base-type.

Common patterns with C# and JSON Schema - object extensibility with open versus closed types.

Common patterns with C# and JSON Schema - how to reuse common schema in the definition of a type.

Common patterns with C# and JSON Schema - constraints on a simple data object.

Common patterns with C# and JSON Schema - the simple data object.

Corvus.JsonSchema enables safe use of the very high performance JSON parsing offered by .NET's System.Text.Json.

Our experience shows that the the most successful data projects rely heavily on building a multi-disciplinary team.

How to combine ASP.NET Core, Razor, and HTMX to power interactive Chart.js visualisations.

Architectural Decision Records (ADRs) capture context, options, decisions, and consequences. dotnet-adr is a .NET tool for managing ADRs.