Clearance: NPPV3 preferred
We have a requirement for a Data Engineer to join a growing data function, supporting the design, build and optimisation of a modern data platform.
You will be responsible for developing scalable data pipelines, ETL processes, and data integration solutions, enabling high-quality data to drive analytics, reporting, and business insight.
This is a hands-on role working closely with data analysts, BI developers, and stakeholders to deliver reliable, efficient, and secure data solutions.
Key Responsibilities
Data Engineering & Pipeline Development
- Design, build, and maintain scalable ETL pipelines
- Develop robust processes to extract, transform, and load data from multiple sources
- Optimise data pipelines for performance, reliability, and scalability
- Write and maintain ETL scripts to support data integration and analytics
- Combine and structure datasets to enable insight generation and analytics
- Clean, transform, and store data to maximise usability and value
- Automate manual data processes to enable repeatability and efficiency
- Work with stakeholders to understand data requirements and translate into technical solutions
- Collaborate with analysts and BI developers to support reporting and visualisation
- Provide guidance on effective use of data infrastructure
- Implement data quality checks, validation, and cleansing processes
- Ensure data accuracy, integrity, and consistency
- Adhere to data governance, privacy, and security standards (e.g. GDPR)
- Support data anonymisation and secure data handling
- Diagnose and resolve data pipeline and dataset issues
- Ensure timely delivery of high-quality data
- Monitor and improve pipeline performance
- Document data flows, pipelines, and technical processes
- Contribute to development of data engineering standards and best practices
- Stay current with modern data engineering tools and technologies
- Recommend improvements to tooling, processes, and architecture
- Strong experience in data engineering and ETL pipeline development
- Proficiency in SQL and at least one scripting language (Python or R)
- Experience working with large and complex datasets
- Strong understanding of relational databases and data structures
- Experience integrating and transforming data from multiple sources
- Knowledge of data governance, security, and compliance
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Experience with Azure Data Factory, Synapse, or similar ETL tools
- Familiarity with cloud platforms (Azure or AWS)
- Exposure to Power BI or data visualisation tools
- Experience building automated testing for data pipelines
- Public sector or regulated environment experience
- NPPV3 clearance preferred
- Eligibility/willingness to undergo security clearance
