Data Engineer

Requirements of the role

We have an opportunity for a Data Engineer to join our IT Team within Corporate Enablers Directorate.

The Data Engineer will be working within the Corporate Enablers Directorate which is a collective of five vital functions that provide support to all teams across Ofwat. Consisting of Digital and IT, Security, HR, Finance, Procurement and Facilities. Our Corporate Enabler teams help to enable Ofwat to be a high performing, great place to be that is effective, efficient and continually improving. They also ensure that we have the right capabilities, tools and culture to deliver for customers, society and the environment.

This role will be part of the Digital and IT Function and be part of the new Data Platform Services Team for which we are recruiting a new Head of Data Platform.

You can find out more about why you should join Ofwat, our strategy, values and our framework for success in the attached Information for Candidates Pack.

Job description
The Role

We are offering an opportunity for a talented Data Engineer to join our emerging Data Platform Team. This team is expanding as part of our plans to upgrade and modernise our data platform through Ofwat’s dedicated programme – Programme Ocean. Programme Ocean is an ambitious data modernisation programme using cutting edge and evolving technology as we look to maximise the data and bring value added insights to Ofwat. The platform has been built using Microsoft tools – Fabric, Purview and Power Bi.

As Data Engineer, you’ll work on both our legacy data platform (Fountain) as well as the new Data Platform, blending the old and new and making sure that there is integrity and the right framework of pipelines and processes to be able to move to the new data platform. Whilst a key part of the role will be to ensure that we continue to support the business on the Fountain platform, the role will be key in helping to migrate to the new platform.

There will be opportunities to work on a range of technologies not just those supporting the Ocean Data Platform but will expand to other Microsoft 365 tools and software that supports other data services across Ofwat, be it those in operation or on new innovation and experimentation initiatives.

You’ll work in a small team of Data Engineers, alongside other Digital and IT roles, to bridge the gap between data producers and data users, developing solutions, pipelines, and self-service tools to acquire and transform data, making it available in our new data ecosystem. You will work alongside the Programme Ocean and Data Strategy team to ensure we are delivering on our programme outcomes to migrate to a modern data platform to support our regulatory duties.

Key deliverables:

In this role you will be expected to:

Support our current data platform built using Java, Tomcat and MySQL.
Support and maintain the Ocean Data Platform technology infrastructure – Microsoft Fabric and Purview.
Develop and optimise code, tools and services that enable people to use data effectively.
Help Ensure Backups and security arrangements are robust and up to date.
Gather requirements and collaborate with technical and non-technical teams.
Upgrade tools, technologies and ensure automation of processes where possible.
Create and maintain data lakes and data warehouse.
Work with and maintain data in Microsoft Fabric.
Establishing effective data lineage, a data catalogue, and metadata management as we implement and enhance the use of Microsoft Purview.
Integrate data from a variety of sources and formats from internal and external sources.
Design and implement ETL (extract, transform, load) pipelines and code to ensure optimum operation.
Design and build robust and scalable automated data flows to connect to our new data platform and ensure timely and quality data for analytics and business intelligence (BI) systems.
Maintain and develop technical documentation and user guides.
Recognise opportunities to reuse and re-engineer data flows to enable scaling and repeatable use.
Provide support to colleagues, proactively sharing skills and knowledge.
Develop your skills through continued learning and development.

View on member website