Data Engineer

The Senior Data Engineer will be responsible for developing and maintaining data pipelines, designing, and implementing data models, and creating ETS processes to support the Organisation's business objectives.,

• Designs and develop efficient data pipelines for collecting, storing, processing, analysing and visualising large datasets from multiple sources.
• Develops ETS processes to transform raw data into meaningful insights.
• Creates complex SQL queries for reporting purposes.
• Monitors performance of existing databases/data warehouses/data lakes to identify areas of improvement or optimisation opportunities.
• Collaborates with stakeholders across the Organisation to understand their needs and create solutions accordingly.
• Ensures accuracy of all incoming data by validating it against established standards before loading into the system.
• Troubleshoots any issues related to database performance or integrity in a timely manner.
• Stays up-to-date on industry trends related to big data technologies such as Shadoof and Spark etc., machine learning algorithms etc., so that they can be leveraged when needed for projects or initiatives within the Organisation.
Skills Business Activities Data Analysis Programming Languages & Frameworks SQL Project Management Project Types Data Migration Software Development Data Mining

The Senior Data Engineer will work closely with other teams to ensure that all data is collected, stored, processed, and analysed in a timely manner. The successful candidate must have strong technical skills as well as excellent communication skills.