Senior Data Engineer

Our Data Engineers provide support to the Data Services department's data integration work, including developing data models, supporting the Trust's analytics environment, and writing scripts and packages for data integration and data analysis. The role will work closely and collaboratively with members of the Analytic Services team who together, make up the Data and Analytic Services function. This will involve defining requirements, surfacing and analysing data, integrating data from a variety of sources (structured and semi-structured), and deploying high quality data pipelines in support of the analytics needs of the Trust.
The role will involve identifying opportunities for the reuse of existing data flows, optimising data flows, performance tuning, and implementing best practices in data management and governance., 1. Work closely with colleagues and stakeholders to develop new ideas, solutions and strategies for improving patient care and clinical outcomes.
2. Design, develop, and test robust, scalable data pipelines and architectures to support data ingestion, processing, and storage.
3. Conduct testing of solutions, review requirements and specifications, and define test conditions. Identify issues and risks associated with work. Analyse and report test activities and results.
4. Select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions using a highly developed specialist knowledge of analytical techniques and methods including an excellent understanding of NHS information and associated datasets.
5. Collaborate with Data Analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
6. Develop and implement efficient ETL (Extract, Transform, Load) processes to integrate data from various sources into centralised data repositories.
7. Document data architecture, processes, and workflows for reference and knowledge sharing.
8. Utilise programming languages (e.g., C#, Python, SQL) and technologies (e.g., Apache Spark, SSIS, .NET) to manipulate and analyse data.
9. Participate in code reviews, version control (e.g., using Git), and other software development best practices to ensure code quality and maintainability.

This is a terrific opportunity to shape the design and development of a greenfield data mart that will be used to model the processes supported by a new trust wide Electronic Patient Record (EPR) system. We are seeking two experience Senior Data Engineers, able to work independently at a senior level, with significant data modelling experience in addition to data pipeline design, development, and testing experience.

At HDFT we provide outstanding care to both our patients and our staff and we value Kindness, Integrity, Teamwork and Equality. If you're looking for an interesting and rewarding career in the NHS, where you can make a real difference to patients' lives, HDFT could be the place for you!

+ A supportive culture so colleagues can bring their whole selves to work.
+ Staff Recognition - as well as regular appraisals, we recognise achievements with our Making a Difference & Team of the Month Awards, along with annual Colleague Recognition Awards.
+ Employee Support and wellbeing - we offer a wide range of staff benefits including an Employee Assistance Programme, counselling service and a fast-track Physiotherapy service.
Please note:
+ Due to high levels of interest, posts may close early if we reach a sufficient number of applications
+ Visa sponsorship is only available for certain roles. Please ensure the role you are interested in meets the criteria for a visa before submitting your application.
+ Please also be aware that the Trust does not offer relocation packages for Agenda for Change roles.
+ All job offers are subject to satisfactory pre-employment checks.