Data Engineer - Open Data

With the introduction of Stream, we are creating a new team here within our Digital Department to comply to these new regulations, so you'll be joining at a great time, to really 'put your stamp' on how this team will evolve. Working in a close-knit team of 3, including a Software Engineer and the Data Lead, you will be ultimately responsible for ensuring the data we need to share, is collected, and formatted in a useable way. Job Overview In this role, you will be working with different types of data; streaming data, batch data and drawing data from API's. You will be working on Azure Databricks and data factory to ensure data is transformed and modelled, alongside other pipelines. The department are moving towards SQL so you will get more involvement in that area over time. Day to day you'll be responsible for:

• Extracting data
• Listening and interpretating stakeholder requirements
• Data profiling
• Establishing data integration processes
• Data modelling
• Resolving issues as/when they occur
• Designing, coding, testing, correcting and documenting moderate-to-complex programs and scripts from agreed specifications, Our customers are at the heart of everything we do, because delivering water for life is our core purpose. To achieve this, we need 24/7 support in place to resolve incidents quickly and efficiently. All our employees understand the importance of out-of-hours incident support - because when problems appear, fixing them is our top priority. That's why our people join together and support when and however needed to make sure our customers get the service they deserve. Joining the Southern Water family means you'll become part of our incident support team. During your interview, your manager will speak to you about any incident support rotas that apply to your position.
Privacy Statement: Please note: If you are an existing Southern Water employee, you will need to confirm within your application that your Manager is aware of your application. All applicants must be eligible to live and work in the UK. You will need to provide evidence of eligibility (e.g. a passport or long birth certificate and proof of NI) and current proof of address (dated within the last 3 months), will be required as part of the recruitment process. If you do not meet these criteria, your application will not be considered. #LI-AW1 #LI-Hybrid

To be suitable for this role, you will have a good understanding of data, working on Azure Databricks and SQL. You will have good working knowledge of extracting data from on-premise infrastructure and how this integrates with off premise. You will have knowledge of:
• SQL database design, Databricks, Azure
• Programming languages such as Python and R
• Extracting data from on-premise
• Writing code
You will also have:
• Strong team player attitude with the ability to collaborate with internal stakeholders
• Technical skills and ability to drive change in the team and/ or department
• Pro-active - always looking for continuous improvement opportunities
• Determination to succeed
• Experience in data pipeline builds, data management, data warehousing, data modelling, data science and analytics
  
  Package
This role will be full time Monday to Friday with a hybrid approach to working between our Durrington office and home, what that looks like if flexible for the right candidate. This is a full-time role, but 30 hours part time will also be considered. We are offering a salary of up to £60,000 per annum depending on skills and experience as well as other benefits including:
• Generous pension up to 11% company contribution
• 25 days annual leave
• Life assurance equal to 4x salary
• Salary sacrifice electric car scheme (after 6 months service)
• Health Cash Plan
• Full funded eye tests
• Two paid volunteering days a year
• Occupational health service
• Discounts with over 800 popular retailers
• Digital GP service