Senior Data Engineer

The Home Office works to build a safe, fair and prosperous UK. We achieve this through our work on counter-terrorism, policing, fire, crime, drugs policy, immigration and passports. The Science, Technology, Research and Analysis (STAR) Group sits at the heart of the Home Office. The group ensures the best evidence and analysis are used to address the strategic issues facing the department. We also provide the science, technology, data, and international insights and collaboration capabilities to drive delivery. Part of the Home Office Analysis & Insight directorate, the Performance Reporting & Analysis Unit (PRAU) provides reporting and analysis of performance for the Migration & Borders Mission and associated operational Capabilities. The successful candidate will join a team tasked with the implementation of complex data flows to connect operational systems, data for analytics and BI systems. PRAU's DDI Team are looking for a development training lead to assist in the delivery of the Vantage Business Information system. You will have the opportunity to work with fellow members of the Data Engineering community to set the direction of the service technology and data architecture, mentoring more junior members of the team - promoting challenge, collaborating, and encouraging an agile approach to working. Working alongside our current experienced staff development lead you will be a part of PRAU's own in-house development function. The function is expected to develop and deliver SQL training to PRAU's reporting teams, specialist users from operational teams, and work closely with the DDI Lead Developers and Head of Unit to ensure that available technologies are exploited fully by PRAU and its partners. As a Senior Data Engineer, you will also identify, build, modify and manage data flows between complex systems using the appropriate solution. You will be working with the Data Services Science community, who set the scope of data engineering work through user research and data pipelines. Through sharing work with Product Owners, you will identify strategies for how the service is best able to support business needs. You will need to meet the essential criteria but training and support on our methods and tooling will be provided.,

• Developing and delivering technical training, in person and virtually, to staff with different levels of experience.
• Analysing problems to identify issues and assisting in the development of innovative solutions. Analysing and reporting test activities and results.
• Designing and implementing new data streaming services, data models and ETL processes. Ensuring the successful delivery of completed data loads for customers, troubleshooting where required.
• Developing complex or large-scale solutions, through full development, test, and deployment lifecycles. Designing, writing, iterating and optimising code from prototype to production ready. Role modelling continuous improvement, through functional and non-functional improvements.
• Creating data models in line with principles across multiple subject areas and providing guidance on how to use them.
• Contributing to the re-platforming of data systems into public cloud and the refresh of tooling applications.
• Leading work on database management and mapping data to the agreed data model. Reviewing requirements, specifications and defining test conditions. Translating and presenting clear insights from data profiling and source system analysis to support the end use of the data.
• Working with data privacy and information security staff to assure that security and privacy requirements are identified and addressed in solutions.
Working pattern This role is available on a full-time basis with the option of compressed hours working. This role is also suitable for part-time working hours, with a minimum requirement to work 30 hours per week due to business requirements.