Lead Data Engineer

Ministry of Housing, Communities & Local Government, Bristol

Lead Data Engineer

Salary not available. View on company website.

Ministry of Housing, Communities & Local Government, Bristol

  • Full time
  • Permanent
  • Onsite working

Posted today, 18 Oct | Get your application in now to be one of the first to apply.

Closing date: Closing date not specified

job Ref: 14dea70b9cf74e588e2ea1883a9dfe15

Full Job Description

  • increasing understanding - among citizens, civil society, central government and local government itself - about what data suggests about the performance of individual local authorities
  • helping to identify local authorities that might benefit from extra support
  • providing support to local government - for example by disseminating best practice or by helping local authorities to improve their own digital and data capability. Oflog is currently an office of MHCLG, meaning all staff are MHCLG civil servants
  • this is an exciting opportunity to define how Oflog manages its data and supports a range of projects across the department
  • the Lead Data Engineer will collaborate closely with the data tools, analytical and data science teams, as well as wider Oflog. They will help manage and streamline processes to support the development of dashboards, semi-automated reporting and wider analytical investigations and modelling, directly contributing to the delivery of Oflog's strategic objectives
  • this is an ideal role for someone who wants to be involved in improving the way the organisation manages and makes use of data, as well as ensure efficient use of automated processes. This is especially important as Oflog grows its use of data across multiple teams
  • we're looking for someone who is motivated to support projects with real-world impacts while promoting a positive work culture. They will need strong data manipulation skills, a focus on robust quality assurance methods and the ability to lead a small team
  • in MHCLG, we have a culture of continuous improvement and feedback driven development which we will support within your development, We particularly welcome candidates from an ethnic minority background and other underrepresented groups to apply, as we work to continually improve our ability to represent the places and communities we support through our work.
  • Find out more about what it's like to work in a digital, data and technology role at MHCLG including our culture, ways of working, career progression and staff benefits. You can also read the MHCLG Digital blog to learn about the work we're doing. As a Lead Data Engineer you'll:
  • lead a data engineering team overseeing the design, maintenance and use of an Extract, Transform, Load pipeline, including data integration; managing quality; maintaining code-base; problem resolution
  • improve the systematic ingestion of data into Oflog - making use of existing APIs and scripting transformation routines
  • develop and uphold standards for metadata ingestion
  • liaise with relevant dependent teams, responding to changing demands and managing the prioritisation of activity across the team accordingly
  • oversee and contribute towards the maintenance and iterative improvement of the infrastructure underpinning our data engineering capability
  • lead engagement with teams across Oflog and identify opportunities to improve the systematic capture and reuse of data, There may be opportunities for candidates to work flexibly depending on the business needs. This will be discussed with the vacancy manager on a case-by-case basis if you are successful for the role.
  • Please note: The Darlington Economic Campus is a pioneering new cross-government hub which will bring together people across departments and public organisations to play an active role in the most important economic issues of the day. The work of the Campus will make a real difference to people both across the UK and internationally. There will be substantial career opportunities and exciting prospects - a career at the Campus means you will be working at the heart of Government, with access to the benefits and fantastic opportunities offered by the civil service. This role is based at MHCLG and we will be joined on the campus by:
  • HM Treasury
  • Department for International Trade
  • Department for Business, Energy and Industrial Strategy
  • Office for National Statistics
  • Department for Education
  • For further information on the DEC, please take a look at the attached DEC candidate pack. Sift and Interview dates Sifting is envisaged to take place from Thursday 24th October 2024 with interview dates to be confirmed. All interviews are currently being held remotely via videocall. Reserve List In the event that we identify more appointable candidates than we currently have posts available, we will hold applicant details on a reserve list for a period of 6 months from which further appointments can be made. This may include roles at a lower grade. Candidates placed on a reserve list will be informed of this. Those candidates who do not wish to remain on the reserve list should contact recruitment@communities.gov.uk to be removed from the reserve list. CTC (Counter-terrorism Clearance): Important note Successful candidates for roles based in our 2 Marsham Street building must meet the security requirements before they can be appointed. The level of security needed is counter-terrorist check and the process can take up to 8 weeks to complete. Please note that successful candidates will need to pass the CTC security checks - this requires you to have been resident in the UK for the past 3 years. Please refer to the MHCLG Notes on Security Clearance section of our Candidate Pack for further information on Counter Terrorism Clearance (CTC). Candidates should also note that with effect from 1st August 2018 the department will also check all applicants who are successful at interview, against the Internal Fraud Database (IFD) held by the Cabinet Office. In accordance with the Civil Service Internal Fraud Policy, any applicant who is included on the IFD will be refused employment by MHCLG. Please see the Candidate Pack for further information on the Internal Fraud Database.,
  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

    experience in the selection and implementation of appropriate technologies to build resilient, high-quality and scalable data solutions - from ingestion through to testing and dashboard KPI reporting
  • experience in a range of coding tools and languages (e.g. Python, SQL)
  • experience in the design and maintenance of metadata repositories
  • strong organisational and management skills, with the ability to build, develop and lead a small team of data engineers
  • ability to identify opportunities to improve own and team's processes, including through the innovative use of new tools and data
  • the ability to communicate detailed information succinctly, clearly and with insight, especially to non-technical audiences

    Here at the Ministry of Housing, Communities & Local Government (MHCLG), we work on things that make a real difference to people's lives.
  • Whether it's through the homes we live in, the work of our local councils, or the communities we're all part of, our work is at the top of the political agenda. We have ambitious and far-reaching outcomes to achieve this year and, if you're thinking of joining us, there's never been a more exciting time. We have over 3,500 staff who are based in 20 offices across the UK. The Office for Local Government (Oflog) was established in 2023 to help to make local government even better. Oflog will help to drive and support improvement in local government through a combination of

    £56,748, Alongside your salary of £56,748, Ministry of Housing, Communities and Local Government contributes £16,439 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.
  • Learning and development tailored to your role
  • An environment with flexible working options
  • A culture encouraging inclusion and diversity
  • A Civil Service pension with an employer contribution of 28.97%
  • Things you need to know, In your covering letter, please include in no more than 500 words, how you meet the specification and essential criteria. The interview will be of a blended nature consisting of the following success profiles elements: Behaviour: Changing and Improving, Managing a Quality Service, Leadership Technical The vacancy manager has also requested that a test and presentation will be completed at interview - information will be provided prior to the interview to allow for time to prepare. The technical test will be shared on the screen during the interview. In full the campaign will test the below Success Profile Elements: Experience: Experience will be tested at sift around the essential skills and criteria as listed in the person specification Technical: Technical will be tested at sift and through interview questions which will be based around the essential skills and criteria as listed in the person specification Behaviours: Changing and Improving, Managing a Quality Service, Leadership,
  • The salary for this role will between £61,884 - £66,667 (London), £56,748 - £61,562 (National) depending on the proficiency level assessment.
  • An additional digital allowance may be payable depending on the level of assessed capability up to £9,000
  • For applicants in receipt of existing allowances, we will assess each case individually and aim to match the digital allowance implemented with no detriment.