Data Engineer

As our new Data Engineer, you will be looking beyond the obvious to resolve complex problems, alongside using your technical skills. You'll be responsible for the end-to-end delivery of business needs from toolkit migrations to new innovations using Azure toolkits, primarily using; Azure Data Factory, Databricks, Azure Datalake storage, DevOps, and PowerBI.,

• Building & Maintaining the ETL processes in Azure.
• Adhering to agreed Release Management Process.
• Contribute to ongoing data model design in Azure. Ensure development aligns with the design principles agreed.
• Work with customers & project teams to support the definition of requirements, scope and plan.
• Troubleshoot and investigate anomalies and bugs in code or data.
• Adhere to test and reconciliation standards to produce confidence in delivery.
• Maintain accurate and up to date DevOps.
• Critical collaborative skills, engaging with cross-functional teams, including but not limited to across the analytical community, IT, InfoSec and Compliance.
• Produce appropriate documentation to support ease of access for technical and non-technical users.
• Efficiently respond to changing business priorities through effective time management.
  
  Are you an experienced Data Engineer? Do you have specialist experience in Azure Databricks? Do you enjoy getting stuck into complex problems? If you've answered yes, then you could be the right person to join the Data Engineering team!, To excel in this role, you'll need to be inquisitive for those investigation skills, have a strong design capability and the ability to work with large, complex data sets. Understanding what people need and being able to deliver it are essential, so collaboration, communication and the ability to influence are important attributes., Experience working with a Data warehouse / Lake with multiple source systems and outputs.
• Experience in design and implementation using Azure tools and products - Databricks, Data Factory, Datalake Storage, DevOps
• Knowledge of SparkSQL, T-SQL, SQL Server, Power BI
• Experience in automating data extraction, transformation/manipulation, summarisation, and delivery.
• Logical troubleshooting.
• SparkSQL Performance Tuning.
• Working knowledge of coding in Python.
  
  Diversity and inclusion are very important to us at Cabot, and we value a multitude of diverse talent within our business. We want everyone to be themselves at work and encourage a culture that includes everyone. Our policies ensure that every candidate and employee are treated fairly and with equal opportunities.
• At Cabot we are highly regulated by our clients, as such, any successful candidates will have to undergo a basic credit check and criminal background check. Please note that we are unable to proceed to interview stage if a CCJ, IVA or Bankruptcy appears on a credit file, or if you do not have full right to work in the UK - we are unfortunately unable to offer sponsorship.
  
  Salary of £65,000
• Permanent
• Flexible hybrid working
Not only are we offering a competitive salary and a fantastic bonus scheme, you'll also be entitled to loads of great benefits including, discount and cash back on hundreds of high-street shops and private health insurance, plus much more.