Lead Data Engineer

We are seeking a highly skilled and experienced Lead Data Engineer to join our data team. The successful candidate will be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organization. This role requires a deep understanding of Azure cloud services, Databricks, and modern data engineering practices.

At the DVLA we provide digital services to millions of UK citizens, the motor industries and emergency services. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise our digital services., We are looking for a dynamic and experienced Lead Data Engineer to join our growing team. This role will be instrumental in shaping our data infrastructure, ensuring it supports our strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions.,

• Leadership and Strategy: Lead the data engineering team, setting standards and best practices. Contribute to the strategic direction of our data infrastructure and analytics capabilities.


• Data Architecture: Design, build, and optimize scalable data pipelines and architectures on Azure and Databricks.


• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.


• Innovation: Stay up to date with emerging technologies and industry trends to ensure our data architecture is state-of-the-art.


• Quality Assurance: Implement and oversee data quality processes to ensure accuracy, consistency, and reliability of data.


• Mentorship: Provide guidance and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.


Additional information

Applications will be accepted from full time/part time/job sharers. Full time roles at DVLA consist of 37 hours per week. Part time and/or flexible working may also be available subject to the needs of the business. If you have a flexible or part time working requirement, you should contact the vacancy holder in advance of making an application to avoid possible disappointment later in the process should your desired working arrangements not be compatible with the requirements of the role. To contact the vacancy holder, please use the job contact details listed under 'Contact point for applicants'.

This role will be based in Swansea, and we will be operating a hybrid working model that allows you to work between home and on-site giving you greater flexibility about where and when you work, subject to business needs and this also allows for ongoing support, development, and collaboration with colleagues.

Therefore, the expectation is that you will spend a minimum of 60% of your working time based at your principal workplace (DVLA). We would encourage you to discuss the working arrangements for this role with us during the recruitment process.,
• GDaD Framework - Lead Data Engineer - Technical Understanding (Skill level: Practitioner)


• GDaD Framework - Lead Data Engineer - Problem Resolution(data) Skill level: Practitioner)


• GDaD Framework - Lead Data Engineer - Data Integration Design (Skill level: Expert)


• GDaD Framework - Lead Data Engineer - Testing (Skill level: Working), Experience building and operating one or more large scale data analytic platforms.


• One or more data technology specialism, for example; Data Warehouse, Data Lake or Lakehouse.


Please note that any part of the role profile could be tested at sift/interview.

If invited to interview, this may consist of a range of question types. These could include questions around behaviours and how you would respond in any situation as well as specific examples of things you have done.

The selection process will be designed specifically for the role. As a result, your assessment will include:


• An interview and technical exercise.


Assessment and Interview

As part of the application process, you will be asked to provide a CV to Inspire People (our Recruitment Partners) which outlines your experience and suitability for the role (based on the experience points outlined in the essential criteria on this advert).

On receipt of your CV, DVLA Hiring Managers will complete a sift. Please note; the sift will be completed on a rolling basis whilst the campaign is still live and so there is potential for feedback to be shared with you (on your application) before the advert closes.

If at sift your application is successful, you will be invited to the first stage of the interview process (hosted by inspire people), where you will be asked to complete a pre-recorded video interview (this again will be based on the experience points outlined in the essential criteria on this advert).

If you are successful at this stage, you will be invited to a final stage interview (which will include an assessment) and be conducted by DVLA Hiring Managers.

Final stage interview/assessments will take place from Wednesday 10th July 2024.

At the final interview stage, you will be assessed against various Behavioural and Technical elements. (Find more information around these elements by following the Success Profiles and Technical skill links in the advert).

This interview will be conducted via a video, details of which will be provided, should you be selected for interview.

Please familiarise yourself with the Government Digital & Data framework as you will be tested on elements of this during the interview stage.

Government Digital Data Profession Capability Framework - Lead Data Engineer

• Technical Understanding - You can show a thorough understanding of the technical concepts required for the role, and can explain how these fit into the wider technical landscape (Skill Level: Practitioner).



• Problem Resolution(data) - You can ensure that the most appropriate actions are taken to resolve problems as they occur, co-ordinate teams to resolve problems and to implement solutions and preventative measures (Skill Level: Practitioner).


• Data Integration Design - You can establish standards, keep them up to date and ensure adherence to them, keep abreast of best practice in industry and across government (Skill Level: Expert).


• Testing - You can review requirements and specifications, and define test conditions, identify issues and risks associated with work, analyse and report test activities and results (Skill Level: Working).


The Department for Transport alongside other Government Departments recruit using Success Profiles. This means for each role we consider what you will need to demonstrate in order to be successful. This gives us the best possible chance of finding the right person for the job, drives up performance and improves diversity and inclusivity.

For further information on Success Profiles visit our Careers website.

Please take note that DVLA does not hold a UK Visa & Immigration (UKVI) Skilled Worker License sponsor and are unable to sponsor any individuals for Skilled Worker Sponsorship.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

Reasonable adjustments

As a Disability Confident Leader employer, we are committed to ensuring that the recruitment process is fair, accessible and allows all candidates to perform at their best. If a person with a visible or non-visible disability is substantially disadvantaged, we have a duty to make reasonable changes to our processes.,
• UK nationals


• nationals of the Republic of Ireland


• nationals of Commonwealth countries who have the right to work in the UK


• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)


• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)


• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020


• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
  
  The value of allowance awarded will be based on an assessment of your skills and experience as demonstrated through the selection process.


Are you an experienced Data Engineer with a deep understanding of Azure Cloud services?

Are you looking for a role within a reputable public organisation?,
• Technical Expertise: Extensive experience with Microsoft Azure and Databricks, including data storage, processing, and analytics.


• Programming Skills: Proficiency in Python, SQL, and other relevant programming languages.


• Big Data Technologies: Experience with big data technologies such as Apache Spark.


• Data Warehousing: Strong knowledge of data warehousing concepts and solutions.


• Problem-Solving: Excellent problem-solving skills with a detail-oriented approach.


• Leadership: Proven ability to lead and inspire a team of data engineers., This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.
  
  If you would like to meet and talk with one of our Lead Data Engineers, find out more about the role, the digital team and what it's like to work at DVLA then we are organising a familiarisation session where you can virtually 'meet the team' on Wednesday 19th June at 12:30pm., We strive to ensure that DVLA is a great place to work where everybody can be their true self, be treated with dignity and respect, and according to their individual needs. We have a number of staff network groups run by staff to support their colleagues.


Working for the DVLA Digital Team

At DVLA, licensing is just the start. Every project you implement, touch and deliver has a ripple effect that'll wash across the nation. Here the work you're doing has the capacity to change the way 50 million people interact with our services. As we aim to keep our roads some of the safest in the world, our innovative, transformative digital-led services help optimise a nation of individuals and business every single day.

To see how our people are transforming our digital services, head over to our DVLA Digital Services Blog and, to understand more about the great opportunities and benefits of working at DVLA read our Inside DVLA blog.

Due to the evolving nature of the business, vacancies can become available at any time. Therefore, this campaign may create a reserve list to fulfil demand if it arises which will be held for a period of 12 months.

Salary: £51,997 - £80,400

The role is part of the Government Digital and Data profession and utilises an enhanced Capability-Based Pay Framework which provides access to a Digital and Data allowance.

The base pay is £51,997. In addition to this the role includes a Digital and Data allowance of up to £28,403., Passionate, reliable and always willing to push yourself and those around you, you'll continue to seek improvement in your own role and challenge us too. Because we pride ourselves on how we approach your development. From training courses to specialist skills workshops and opportunities to grow your expertise, we thrive when you thrive. You can find out more about all of the above here alongside a full list of our benefits:

• Best in class learning and development tailored to your role


• An environment with flexible working options where we encourage a great work-life balance


• A culture encouraging inclusion and diversity with a range of staff communities to support all our colleagues


• Generous employer contribution of at least 26.6%, depending on rate of salary and chosen pension scheme


• Digital communities with clear career frameworks


• On-site gym plus personal training available (membership applies)


• On-site nursery, restaurants and coffee bar


• 25 days holiday (plus bank holidays), increasing by 1 each year (up to 30) & 1 extra day for the King's birthday


• Free parking


Things you need to know