Data Engineer

We're looking for a Data Engineer to help us develop and maintain the automated data pipeline that drives the Gross Margin output, keeping it as accurate as possible against the views of revenue and costs presented by our billing system and industry flow data whilst also optimising the way we process large datasets to be scalable for further exponential growth.,

• Ensuring teams get the regular reporting they need: finance to support accounting and audit requirements, operations to support billing & settlement accuracy;


• Finding and solving problems leading to changing trends or irregularities in the financial numbers caused by changes in source data;


• Working with a wide variety of Octopus teams to align and improve logic where possible;


• Designing and implementing flexible tools that allow different teams to take advantage of the highly granular calculations we're already performing;


• Setting up dashboards to automate reporting and track data health;


• Taking any opportunity to optimise existing pipeline architecture to be more scalable for exponential customer growth;


• Building new pipeline architecture for new projects;


• Supporting gross margin accountants and analysts to level up their coding skills., SQL-based dbt pipelines running on Databricks


• Analysis via Python notebooks


• Pyspark jobs on Databricks workflows for heavy lifting


• Streamlit and Python for dashboarding


• Airflow for ETL


• Notion/Secoda for data documentation
  
  This is a fantastic opportunity to take on a role that combines complex data engineering with in-depth market understanding and financial analytics to deliver critical business reporting. While experience in finance is beneficial, we are open to candidates who may not have a financial background but are keen to learn and grow in this area., Strong aptitude with SQL and Python;


• Keen eye for detail to find root causes and solve problems;


• Ability to quickly understand new domain areas and visualise data effectively;


• Ability to translate technical code logic for a variety of business stakeholders;


• Team player excited at the idea of ownership across lots of different projects and tools;


• Experience with dbt, Airflow and Spark optimisation would be a big plus.
  
  Octopus Energy is now one of the largest suppliers of gas and electricity to UK householders, with 6.5 million customers and a multi-billion pound turnover - our Gross Margin team is responsible for producing key financial outputs to report on the profitability of the business and the different products we offer to customers.