Head of Data Engineering

Type: Permanent Candidates should take the time to read all the elements of this job advert carefully Please make your application promptly. Posted On: 03/12/2023 Head of Data Engineering required by an AI business who is changing an industry. You'll be leading the build out of a real time streaming platform from scratch, that will become the organisation's all in one data platform and golden source for data. This proprietary data platform has scope for a lasting impact worldwide. What we offer

• Lucrative Stock options
• Hybrid working in London office
Our growing success comes from providing next generation technological solutions in an accessible and easy to operate way. We are a Data-Driven company using Knowledge Graphs, with AI at the heart of our software. This is powered by mammoth quantities of data and is changing the way that software and data platforms are built. Role
• Head of the Data Engineering function but still cutting your teeth in hands-on delivery and latest data industry trends
• Lead, mentor, coach and inspire your team. Currently 5, to grow to 11 when you're on board
• Provide leadership in the designing and delivering of various initiatives, including building a largescale bespoke data platform, streaming services, and Big Data
• Bringing ideas to the data tooling, systems and techniques; including architectural patterns that work with Software Engineers and Data Science teams
• Effectively prioritise and deliver to a clear roadmap of deliverables
• Communicate effectively with stakeholders to ensure requirements are well understood and stakeholders have accurate expectations on dates and functionality
Requirements
• Experience building a data platform with streaming tech (Pulsar, Kafka, Kinesis)
• Design, build and launch highly available and distributed systems for data extraction, transformation and loading of datasets
• Excellent communication and leadership skills, including the ability to initiate and drive projects proactively
• DataOps and ways to improve Data quality
• Track record building custom data frameworks and platforms
• Agile and Continuous Delivery
• Continuous integration pipelines
• Strong Python
• AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc)
• ETL management; structured or custom (Airflow, Luigi, etc)
Bonus
• Robust experience managing and developing an engineering team
• Delta lake or Iceberg
• Trino or Presto
• GraphQL
• Good salary, bonus, stock options, Private Healthcare, Dental cover, choice of own equipment, ongoing professional development, remote working, Perkbox, work towards relevant certifications
Why Join? We're a technology centric company who are really going places! We have massive plans and build great solutions to back it up. We push the boundaries of what is possible and the work in turn is both thrilling and challenging. We provide an environment to thrive. If you're craving rapid growth, able to create a path in uncharted territory, and comfortable with trying, failing and course-correcting fast, come join the team! Sound interesting? Please apply to find out more!


• Experience building a data platform with streaming tech (Pulsar, Kafka, Kinesis)
• Design, build and launch highly available and distributed systems for data extraction, transformation and loading of datasets
• Excellent communication and leadership skills, including the ability to initiate and drive projects proactively
• DataOps and ways to improve Data quality
• Track record building custom data frameworks and platforms
• Agile and Continuous Delivery
• Continuous integration pipelines
• Strong Python
• AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc)
• ETL management; structured or custom (Airflow, Luigi, etc)
  
  Robust experience managing and developing an engineering team
• Delta lake or Iceberg
• Trino or Presto
• GraphQL
• Good salary, bonus, stock options, Private Healthcare, Dental cover, choice of own equipment, ongoing professional development, remote working, Perkbox, work towards relevant certifications
Why Join? We're a technology centric company who are really going places! We have massive plans and build great solutions to back it up. We push the boundaries of what is possible and the work in turn is both thrilling and challenging. We provide an environment to thrive. If you're craving rapid growth, able to create a path in uncharted territory, and comfortable with trying, failing and course-correcting fast, come join the team!