Spark

This post describes an approach to write data to SharePoint from Synapse Notebooks.

This post describes an approach to copy files and data from SharePoint into Azure using Synapse Notebooks.

Once you've thoroughly tested your code against the local Spark service in your dev container, you'll want to run it in a real Spark cluster. This posts shows how to deploy such code to Microsoft Fabric.

Having seen earlier in the series how to configure a dev container to run Spark locally, this post shows how to write tests that use that local Spark service.

See how to configure a dev container to run Spark locally, to improve development feedback loops.