Data Engineer Lead - International Data and Analytics
AbbVie, Marlow, Buckinghamshire
Data Engineer Lead - International Data and Analytics
Salary not available. View on company website.
AbbVie, Marlow, Buckinghamshire
- Full time
- Permanent
- Onsite working
Posted 2 weeks ago, 5 Dec | Get your application in now before you miss out!
Closing date: Closing date not specified
job Ref: 87dc2a38192648bf9c69e5d496a3e2f5
Full Job Description
BTS Data and Analytics team in the AA International Commercial Business is spearheading the transformation of our organization into a data and insights-driven enterprise. We are looking for a talented Data Engineer Team Lead to join our dynamic data and analytics team. In this pivotal role, you will be instrumental in designing, building, and maintaining data solutions using Palantir Foundry, thereby supporting our data-driven initiatives and decision-making processes. This individual will lead our Data Engineering team and will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality, and driving innovation through data engineering solutions. Leadership skills are essential, and we recognize that these can be transferable and need not be gained exclusively from previous data engineering lead roles. In this role you will be reporting to the International Associate Director of Data & Analytics, and you will be responsible for: Data Engineer Responsibilities (50%)
- Planning, Building, and Running Enterprise Data Products on Palantir Foundry: Execute the development and operational functions for enterprise data products ensuring optimal performance and reliability.
- Designing, Developing, Testing, and Maintaining Data Pipelines to Support Analytics Projects within Commercial: Focus on creating robust data pipelines that facilitate seamless data integration and transformation.
- Building Data Products and Service Processes for Data Transformation, Metadata Extraction, Workload Management, and Error Processing Management: Execute detailed data product development tasks including data transformation and workload handling.
- Develop and Optimize ETL Processes for Timely and Accurate Data Delivery: Implement and fine-tune ETL processes to ensure data is delivered effectively and accurately.
- Adhering to Best Practices for Coding, Testing, and Designing Reusable Code/Components: Implement industry-standard coding practices to produce clean, efficient, and reusable code. Team Lead Responsibilities (50%)
- Team Management: Lead a cross-functional team of data engineers, business systems analysts, and data scientists. Actively provide mentorship, feedback, and development opportunities.
- Design, Implement, and Maintain Scalable Data Products in Palantir Foundry: implement the architecture and scalability of data products ensuring they meet future needs.
- Implementing Standardized, Automated Operational and Quality Control Processes: Define and supervise the implementation of standardized processes for operational excellence and quality control.
- Ensuring Appropriate Security and Compliance Policies for Information Access and Dissemination: Establish and action security and compliance policies to safeguard data access and dissemination.
- Collaborating with Information Providers to Ensure Quality Data Updates: Manage relationships with information providers to guarantee data updates meet quality standards.
Bachelor's or Master's degree or equivalent work experience., Experience in data engineering, data processing roles such as database developer/administrator, ETL/Big Data developer, data analyst and/or BI analytics developer - Experience with cloud platforms, big data platforms and one or more general purpose programming languages, including but not limited to: Python, SQL, Spark, Amazon Web Services, Typescript and Javascript
- Experience with DevOps principals and version control (Git preferred)
- End-to-end experience with data, including querying, aggregation, analysis, and visualization.
- Good communication and presentation skills, being able to explain complex problems and the solutions applied, and comfortable in presenting technical solutions to a nontechnical audience. Beneficial:
- Experience with commercial analytics platforms and CRM systems (e.g., Veeva CRM, Sales Force Marketing Cloud).
- Experience in supporting and maintaining data platforms and solutions in a "Run" environment, ensuring reliability, scalability, and performance of data lakes and warehouses.
- Demonstrated ability to troubleshoot, optimize, and enhance the operational performance of data platforms.
- Practical experience with Palantir Foundry, including data integration, model development, and deploying data products, objects and entities within the Foundry ecosystem.
- Capability to leverage Foundry's tools to drive data-driven decision-making and operational efficiencies.
- Having worked with commercial and sales analytics within the pharmaceutical industry, including market analysis, sales performance metrics, and customer insights.
- Experience with cloud-based data solutions (e.g., AWS, Google Cloud, Azure Databricks, Snowflake). Tools and skills you will use in this role include:
- Palantir Foundry: Proficient in using Palantir Foundry to integrate, manage, and analyze large datasets.
- PySpark, Python, and SQL: Strong programming skills in PySpark and Python, along with a deep understanding of SQL for data manipulation and querying.
- Data Modeling: Expertise in designing and implementing efficient and scalable data models to support analytics and reporting needs.
- Git, Jira, Confluence: Proficiency in using Git for version control, Jira for project management, and Confluence for documentation and collaboration.
- AWS: Experience with AWS services for cloud computing, storage, and data processing.
- Typescript & Javascript: Knowledge of TypeScript and JavaScript is a plus, adding to your ability to work on full-stack data solutions.
AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on people's lives across several key therapeutic areas - immunology, oncology, neuroscience, and eye care - and products and services in our Allergan Aesthetics portfolio. For more information about AbbVie, please visit us at www.abbvie.com. Follow @abbvie on X, Facebook, Instagram, YouTube, LinkedIn and Tik Tok (https://www.tiktok.com/@abbvie) .