Senior Data Engineer

Octopus Energy Ltd

Senior Data Engineer

Salary Not Specified

Octopus Energy Ltd, City of Westminster

  • Full time
  • Permanent
  • Onsite working

Posted today, 19 Sep | Get your application in now to be one of the first to apply.

Closing date: Closing date not specified

job Ref: 94908ed6f1bc424f9b47650cc5e6402d

Full Job Description

  • Build new data sources and data pipelines that deliver key data and insights to the business.

  • Build data pipelines that power and enable the inner workings of the Kraken platform, from billing and settlement to customer facing apps.

  • Build and maintain testing and documentation frameworks for our data sources.

  • Work with the business to scope and deliver new data engineering projects and requirements.

  • Maintain and build on our existing data infrastructure and tools.

  • Support the internationalisation of our data infrastructure as we continue to grow globally.

    First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code. It would be helpful to have experience/expertise in the following:

  • Python

  • SQL

  • Spark

  • Experience in assuring data quality

  • Experience deploying data services in a cloud environment (ideally AWS)

  • Experience with APIs designed for high volume traffic serving data to customers or business critical applications.

  • Experience with relational databases (Postgres/Aurora)

  • The projects will be varied and we're looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions.

    Help us use technology to make a big green dent in the universe!

  • Kraken powers some of the most innovative global developments in energy.
    We're a technology company focused on creating a smart, sustainable energy system. From optimising renewable generation, creating a more intelligent grid and enabling utilities to provide excellent customer experiences, our operating system for energy is transforming the industry around the world in a way that benefits everyone.
    It's a really exciting time in energy. Help us make a real impact on shaping a better, more sustainable future.
    Kraken Customer
    What we do: build the most AI-driven, innovative, forward-thinking platform for energy management. From optimizing resources to delivering cost-effective, exceptional customer experiences through advanced Customer Information Systems (CIS), billing, meter data management, CRM, and AI-driven communications, Kraken is powering the next wave of innovation in the energy industry.
    Why we do it: future energy will not look like energy as we know it today. We need to not just think about our future, but build for it. Now.
    About our team
    At Kraken we've developed a data platform that is used by Octopus Energy and our other clients retail energy businesses around the world. The platform empowers users with self-service data analytics and automates our data processing workflows, from simple ETL jobs to ML training and prediction.
    The data platform team works across the whole customer domain on anything from natural language understanding of our customer communications to processing billions of smart meter readings every day to support clients in creating customised and market leading smart energy tariffs.
    As the volume, scope and geographical range of our data offerings rapidly expand, we're looking for an experienced data engineer to join the team to help us build and maintain our platform, pipelines and data sources.
    We're passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work with us on data problems that genuinely move us closer to Net Zero, and support the energy transition.