Skip to content

James Broome

James Broome

Director of Engineering

View full profile

James has spent nearly 20 years delivering high quality software solutions addressing global business problems, with teams and clients across 3 continents. As Director of Engineering at endjin, he leads the team in providing technology strategy, data insights and engineering support to organisations of all sizes - from disruptive B2C start-ups, to global financial institutions. He's responsible for the success of our customer-facing project delivery, as well as the capability and growth of our delivery team.

Insight Discovery (part 6) – How to define business requirements for a successful cloud data & analytics project

Insight Discovery (part 6) – How to define business requirements for a successful cloud data & analytics project

James Broome

Many data projects fail to deliver the impact they should for a simple reason – they focus on the data. This series of posts explains a different way of thinking that will set up your data & analytics projects for success. Using an iterative, action-oriented, insight discovery process, it demonstrates tools and techniques that will help you to identify, define and prioritize requirements in your own projects so that they deliver maximum value. It also explores the synergy with modern cloud analytics platforms like Azure Synapse, explaining how the process and the architecture actively support each other for fast, impactful delivery.
Insight Discovery (part 5) – Deliver insights incrementally with data pipelines

Insight Discovery (part 5) – Deliver insights incrementally with data pipelines

James Broome

Many data projects fail to deliver the impact they should for a simple reason – they focus on the data. This series of posts explains a different way of thinking that will set up your data & analytics projects for success. Using an iterative, action-oriented, insight discovery process, it demonstrates tools and techniques that will help you to identify, define and prioritize requirements in your own projects so that they deliver maximum value. It also explores the synergy with modern cloud analytics platforms like Azure Synapse, explaining how the process and the architecture actively support each other for fast, impactful delivery.
Insight Discovery (part 4) – Data projects should have a backlog

Insight Discovery (part 4) – Data projects should have a backlog

James Broome

Many data projects fail to deliver the impact they should for a simple reason – they focus on the data. This series of posts explains a different way of thinking that will set up your data & analytics projects for success. Using an iterative, action-oriented, insight discovery process, it demonstrates tools and techniques that will help you to identify, define and prioritize requirements in your own projects so that they deliver maximum value. It also explores the synergy with modern cloud analytics platforms like Azure Synapse, explaining how the process and the architecture actively support each other for fast, impactful delivery.

James Dawson

James Dawson

Principal I

View full profile

James is an experienced consultant with a 20+ year history of working across such wide-ranging fields as infrastructure platform design, internet security, application lifecycle management and DevOps consulting - both technical and in a coaching capacity. He enjoys solving problems, particularly those that reduce friction for others or otherwise makes them more effective.

Using Cloud CI/CD in Zero Trust Environments

Using Cloud CI/CD in Zero Trust Environments

James Dawson

Performing certain deployment operations from a cloud-based CI/CD agent against resources that are only accessible via private networking are problematic. The often-cited solution is to use your own hosted agents that are also connected to the same private networks, however, this introduces additional costs and maintenance overhead. This post discusses an approach that combines the use of cloud-based CI/CD agents with 'just-in-time' allow-listing as an alternative to operating your own private agents.
How to setup Python, PyEnv & Poetry on Windows

How to setup Python, PyEnv & Poetry on Windows

James Dawson

Using multiple versions of Python on Windows can be a frustrating experience, especially if you've experienced how smooth the same workflow is on MacOS and Linux/WSL. This post provides a script and guide to getting setup to use Python virtual environments and Poetry, a popular dependency management tool.
Adventures in GitHub Actions: Episode 1 - Goodbye Azure DevOps, Hello GitHub Actions

Adventures in GitHub Actions: Episode 1 - Goodbye Azure DevOps, Hello GitHub Actions

James Dawson

This series will follow our ongoing journey of migrating the CI/CD pipelines for our many Open Source repositories, from Azure DevOps to GitHub Actions.

Ed Freeman

Ed Freeman

Software Engineer II

View full profile

Ed is a Data Engineer helping to deliver projects for clients of all shapes and sizes, providing best of breed technology solutions to industry specific challenges. He focusses primarily on cloud technologies, data analytics and business intelligence, though his Mathematical background has also led to a distinct interest in Data Science, Artificial Intelligence, and other related fields.

He also curates a weekly newsletter, Power BI Weekly, where you can receive all the latest Power BI news, for free.

Ed won the Cloud Apprentice of the Year at the Computing Rising Star Awards 2019.

Microsoft Fabric: Announced

Microsoft Fabric: Announced

Ed Freeman

Microsoft Fabric extends the promise of Azure Synapse integration to all analytics workloads from the data engineer to the business knowledge worker. It brings together Power BI, Data Factory, and the Data Lake, on a new generation of the Synapse data infrastructure. Delivered as a unified SaaS offering, it aims to reduce cost and time to value, while enabling new "citizen data science" capabilities. Check out all the resources from the endjin team collated in this post.
What is OneLake?

What is OneLake?

Ed Freeman

OneLake is the core of Microsoft Fabric - it is essentially the storage account for all of your data utilized within Fabric, be that within Azure or from another cloud (through Shortcuts). As the name suggests, it is a single, logical data lake backing more or less all of your Fabric workloads. For fans of analogies: you'll have probably heard Microsoft use the tag-line "OneLake is to data what OneDrive is to files/documents". Read this blog to dive deeper into OneLake and learn about why you should be excited.
Intro to Microsoft Fabric

Intro to Microsoft Fabric

Ed Freeman

Microsoft Fabric is a unified data & analytics platform that brings together, and improves upon, Microsoft's existing suite of data products. It can be thought of as the third generation of Microsoft data platforms, where first generation (e.g. HDInsight, SQL Data Warehouse) were somewhat isolated takes on traditional data products; second generation was Azure Synapse Analytics, which integrated platforms at a UX level but still felt a little disjointed at the data level; and now we have Microsoft Fabric which builds upon the Synapse "unification" vision, with a particular focus on enabling deep data-level interoperability. In this post we introduce its core offerings, as well as weigh up the pros and cons of this new product.

Elisenda Gascon

Elisenda Gascon

Apprentice Engineer II

View full profile

Elisenda is a mathematics graduate from UCL. During her years at university, Elisenda took a couple of introductory modules in Python and Machine Learning, which led her to take a few online courses on those subjects.

After finishing her mathematics degree, Elisenda's motivation to join endjin was a desire to put her problem solving skills to the test and further develop her understanding of technology. She is currently expanding her knowledge of cloud computing and its various applications, and discovering the fascinating world of Microsoft Azure.

Version Control in Databricks

Version Control in Databricks

Elisenda Gascon

Databricks notebooks provide an interactive and collaborative environment for developing code while applying software engineering best practices, such as source control. This blog post provides a step by step guide of how to implement source control in Databricks.
Big Data LDN: highlights and how to survive your first data conference

Big Data LDN: highlights and how to survive your first data conference

Elisenda Gascon

Here are some of the highlights form this year's Big Data LDN conference.
My first year as an Apprentice Engineer

My first year as an Apprentice Engineer

Elisenda Gascon

Eli joined endjin as part of the Software Engineering Apprenticeship 2021 cohort. In this post she reflects on her first year.

Charlotte Gayton

Charlotte Gayton

Apprentice Engineer I

View full profile

Charlotte is seconded to endjin for her Industrial Placement year, as part of her BEng in Computer Science at the University of York. She was part of the summer 2021 internship cohort, and worked on creating a synthetic customer data generation tool to create statistically accurate "fake" data which could be used to create large volumes of realistic data for testing scenarios for endjin's customers.

During her year-long placement at endjin, Charlotte is going to focus on the adoption and roll out of the OpenChain specification (ISO 5230) across endjin's open source projects.

Exploring OpenChain: From License Compliance to Security Assurance

Exploring OpenChain: From License Compliance to Security Assurance

Charlotte Gayton

Open-source software has become an essential part of many organisation's software supply chain, however, this poses challenges with license compliance and security assurance.
Working with JSON in Pyspark

Working with JSON in Pyspark

Charlotte Gayton

This blog shows how to transform a document based format to a tabular format whilst managing all the nested properties
Creating Pester Unit Tests in PowerShell

Creating Pester Unit Tests in PowerShell

Charlotte Gayton

Why you should make writing unit tests a regular practice and how they will improve your code. This blog explains how to write unit tests in PowerShell using Pester.

Liam Mooney

Liam Mooney

Apprentice Engineer II

View full profile

Liam studied an MSci in Physics at University College London, which included modules on Statistical Data Analysis, High Performance Computing, Practical Physics and Computing. This led to his dissertation exploring the use of machine learning techniques for analysing LHC particle collision data.

Before joining endjin, Liam had a keen interest in data science and engineering, and did a number of related internships. However, since joining endjin he has developed a much broader set of interest, including DevOps and more general software engineering. He is currently exploring those interests and finding his feet in the tech space.

Data validation in Python: a look into Pandera and Great Expectations

Data validation in Python: a look into Pandera and Great Expectations

Liam Mooney

Data validation is a vital step in any data-oriented workstream. This post investigates and compares two popular Python data validation packages - Pandera and Great Expectations
How To Implement Continuous Deployment of Python Packages with GitHub Actions

How To Implement Continuous Deployment of Python Packages with GitHub Actions

Liam Mooney

This post demonstrates how to use GitHub Actions to automatically publish updates to your Python package to PyPI, and explores whether this constitutes Continuous Deployment
An Overview of the Corvus.Retry Library

An Overview of the Corvus.Retry Library

Liam Mooney

Corvus.Retry is an open source repository that provides functionality for building policies and strategies for handling transient faults. This post provides a spotlight on the repository.

Paul Waller

Paul Waller

Designer

View full profile

Paul has over 20 years of creative experience in design, and delivering user and customer experiences across 3D, print, and digital disciplines. As endjin’s designer, Paul enables customers and the team to visualise abstract concepts. Whether it’s UX, or dashboards for financial and retail services, television props for the Great British Menu, illustrations and animations for promotion and marketing campaigns, or logos and iconography for design systems, Paul is responsible for making concepts look and feel great, in a way our customers can understand.

How to develop an accessible colour palette for Power BI

How to develop an accessible colour palette for Power BI

Paul Waller

If the audience for your Power BI report is larger than 12 people, then statistically 1 of your audience suffers from Colour Vision Deficiency. In this post we will talk through how we experimented with colour to develop an accessible colour palette and why colour and contrast is important when it comes to data visualisation.
How to enable data teams with the design assets required for impactful data storytelling in Power BI

How to enable data teams with the design assets required for impactful data storytelling in Power BI

Paul Waller

In this post we will talk through how to expand on a data team's creative skillset, without access to specialist photo editing software such as Photoshop or Illustrator.
How to Create Custom Buttons in Power BI

How to Create Custom Buttons in Power BI

Paul Waller

In this post we will talk through a step-by-step guide for how to design and build custom buttons in Power BI. We'll start with the basic foundations of shape and form, to applying icons, states, and actions with the view to extending your brand collateral across your report design and UI.

2021 Internship Cohort

Thea Bautista

Thea Bautista

Intern

View full profile

Thanks to a volunteering placement which opened her eyes to the capabilities of technological innovation, Thea studies Biomedical Engineering at King's College London.

Here, she found her love for code through her programming modules and entertains her tech interests in her spare time through online courses and coding-driven projects.

Wanting to learn more about work-life in a tech company and the ins-and-outs of how businesses are run, she joined endjin's 2021 intern cohort.

From start to finish: my internship at endjin

From start to finish: my internship at endjin

Thea Bautista

Thea studies Biomedical Engineering at King's College London, in this post she summarises her 6 week internship at endjin.

Nehemiah Campbell

Nehemiah Campbell

Intern

View full profile

Nehemiah is a graduate from the University of Bristol, gaining a 1st Class Masters of Science in Mathematics with Statistics. During his summer internship, Nehemiah worked with Python to pre-process, gather insights from data and developed a machine learning model. He has an interest in automating processes to solve daily inefficiencies and building robust solutions.

Nehemiah worked at endjin between 2021-2022.

Month one at endjin

Month one at endjin

Nehemiah Campbell

In this post, Nehemiah reflects on his first month at endjin as an apprentice engineer.

Klaudia Guz

Klaudia Guz

Intern

View full profile

Klaudia is an intern and an Electronic Engineering student at University of Southampton.

During her degree she learned about electronic devices and computer architecture which sparked her interest in technology. This led Klaudia to apply for the internship at endjin and she's hoping to join again next year as an apprentice.

My internship experience

My internship experience

Klaudia Guz

Klaudia studies Electronic Engineering at University of Southampton, and reflects on her two month internship.

Amy Shaw

Amy Shaw

Intern

View full profile

Amy is currently a student at the University of Reading studying Biomedical Engineering.

She loves all things tech and hopes to work as a Software Engineer post-graduation. She loves the problem solving aspects of programming and feeling like she's constantly learning new things.

Outside of academics and work, Amy is passionate about art and enjoys painting in her spare time. She also enjoys languages and is learning Spanish in addition to her native languages English and Khmer.

Amy's summer as an intern endjineer

Amy's summer as an intern endjineer

Amy Shaw

Amy is studying Biomedical Engineering University of Reading, and reflects on her two month summer internship at endjin learning C# and Python, and working on a data science project.

Alumni - gone, but not forgotten!