Java Data Engineer

Salary not available. View on company website.

Qualient Technology Solutions UK Limited, City of Westminster

Posted 4 days ago, 8 Nov | Get your application in now to be included in the first week's applications.

Closing date: Closing date not specified

job Ref: aa4f2de1526c4f83a521e5e39c215d5a

Design and implement scalable data pipelines using Java, Spark, HDFS, and Hadoop.
Transform and aggregate data from multiple sources to create unified, actionable insights.
Optimize data workflows with Spark Core, Spark SQL, RDDs, and DataFrames for high performance.
Apply tuning techniques like caching data in memory and using broadcast hints for SQL queries.
Utilize Azure DevOps for deployment, leveraging CI/CD pipeline best practices.
Collaborate in a Scrum environment, participating in Agile ceremonies.

Qualient Technology Solutions is looking for a skilled Java Data Engineer with expertise in Spark and Hadoop to join our London-based team. This position requires hands-on experience with data engineering, optimization, and pipeline development in a client-focused environment., Strong Java proficiency and experience with Hadoop Architecture.
Deep understanding of Spark Architecture including Spark Core, SQL, and DataFrames.
Experience in performance tuning and optimization strategies.
Familiarity with CI/CD pipelines, Azure DevOps, and Git Bash.
Ability to communicate effectively with clients and understand business needs.
Agile experience with a focus on Scrum methodologies.