Senior Scala Engineer - Data Platform

The Trainline, City of Westminster

Senior Scala Engineer - Data Platform

Salary not available. View on company website.

The Trainline, City of Westminster

  • Full time
  • Permanent
  • Onsite working

Posted today, 21 Oct | Get your application in now to be one of the first to apply.

Closing date: Closing date not specified

job Ref: 28c543d78ee04f88b9c8aba5cb1b6ab7

Full Job Description

As a Senior Data Engineer (Scala), you will be part of a cross-functional data product team working alongside data scientists, machine learning engineers and BI engineers. Our data product teams are deeply embedded in the business so your work will have high impact by either drive key business decisions, provide deep customer insights or by adding intelligent machine learning experiences right in the core of our customer journeys. We use an agile delivery playbook that encourages incremental and iterative delivery, aims to release value early and often, measure the impact of work and using hypotheses to ensure we are solving real customer problems. Our data platform is a modern, cloud-native, lake house using best-of-breed technologies and partners, all based on the AWS public cloud. We empower our Data teams and give engineers high levels of autonomy and freedom to innovate. We encourage continuous learning with clear career progression plans, innovation/hack days and training opportunities such as DataCamp. As a Senior Scala Data Engineer at Trainline, you will...

  • Use cutting-edge Data technology to deliver world-class data products using a combination of streaming technologies, machine learning and automated data pipelines.
  • Work in self-organised, cross-functional data teams alongside machine learning engineers, BI engineers and product managers.
  • Drive continuous improvement to the software engineering and agile working practices of the team.
  • Contribute to the Technical / Architecture direction of the team.

    Thrive in a diverse, open and collaborative environment where impact is as valuable as technical skill
  • Have excellent knowledge of Scala and the JVM ecosystem
  • Possess strong understanding of functional programming paradigms and a willingness to adopt other languages (not only JVM languages)
  • Have consistent background in software development in high volume environments
  • Have a pragmatic and open-minded approach to achieving outcomes in the simplest way possible
  • Have worked with stream processing technologies (Kafka, Storm, AWS Kinesis, etc)
  • Have experience with AWS services especially EMR, ECS, EKS.
  • Have an obsession with software quality, Dev Ops and automation
  • Work well in lean, agile, cross-functional product teams using Scrum and Kanban practices
  • Are a good communicator and comfortable with presenting ideas and outputs to technical and non-technical stakeholders
  • Our technology stack
  • Python
  • Scala and the JVM
  • Kafka, Kafka Streams and KSQL
  • AWS, S3, Parquet, Iceberg, Glue and EMR for our Data Lake
  • Terraform and Docker
  • Elasticsearch and Dynamodb
  • Spark and Airflow
  • Trinio (Starburst) and Presto (Athena)
  • ML Flow and popular Python machine learning and analysis libraries

    Salaire : Non spécifié
  • Télétravail non autorisé Expérience : > 5 ans Trainline, Nous, c'est Trainline, et notre mission, c'est d'aider le plus de gens à voyager plus vert, moins cher et sans prise de tête : On vend les billets de plus de 270 compagnies de train et de bus dans 40 pays d'Europe, via un site et une app disponibles dans 14 langues et plus de 175 pays. Réservation, gestion, suivi des trajets : on accompagne nos clientes et nos clients du tout premier clic au pied posé en gare d'arrivée à travers une expérience (vraiment) optimisée. On fait aussi du B2B : on vend notre technologie à des agences de voyage et à des compagnies partenaires, et on propose notre offre de voyages d'affaires à des entreprises. Pour faire tout ça, on développe l'outil le plus avancé pour centraliser, comparer, vendre et gérer l'après-vente de millions de billets de train et de bus (grâce au talent de nos as de la tech). Aujourd'hui, Trainline est incluse dans le FTSE 250, fait un chiffre d'affaires annuel de plus de 6,1 milliards d'euros et compte plus de 1 000 personnes de plus de 50 nationalités, réparties un peu partout en Europe : Paris, Londres, Édimbourg, Milan, Barcelone, Berlin, Bruxelles…