We are looking for an experienced Data Engineer with strong expertise in building scalable ETL/ELT pipelines, data integration frameworks, and cloud-based data solutions. The candidate will be responsible for developing reliable data platforms to support enterprise analytics, AI, and reporting requirements.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines.
Build data integration and transformation solutions using cloud technologies.
Develop data models, data warehouses, and real-time data processing solutions.
Implement data quality, validation, security, and performance optimisation practices.
Support AI/ML and analytics workloads and collaborate with Data Scientists and business teams.
Implement CI/CD and MLOps practices for automated and reliable data deployments.
Desired Candidate Profile
Databricks, Azure Data Factory, Azure Data Lake
PySpark, Python, SQL, Delta Lake
Kafka / Real-time data processing
ETL/ELT, Data Modelling & Data Warehousing
Data Quality & Performance Optimisation
CI/CD, MLOps and Cloud Data Engineering
Education: Bachelor’s/Master’s degree in Computer Science, Engineering, Data Engineering, or a related field.
Skills
Databricks
Azure Data Factory
PySpark