Skip to content

Spark

Spark dev containers: packaging code for testability

Spark dev containers: packaging code for testability

Ian Griffiths

Once you've thoroughly tested your code against the local Spark service in your dev container, you'll want to run it in a real Spark cluster. This posts shows how to deploy such code to Microsoft Fabric.
Spark dev containers: writing tests

Spark dev containers: writing tests

Ian Griffiths

Having seen earlier in the series how to configure a dev container to run Spark locally, this post shows how to write tests that use that local Spark service.
Spark dev containers: running Spark locally

Spark dev containers: running Spark locally

Ian Griffiths

See how to configure a dev container to run Spark locally, to improve development feedback loops.