We are looking for a skilled Data Engineer to design, optimize, and maintain efficient data structures that support high-performance data processing and retrieval. The ideal candidate will have a strong foundation in algorithms, databases, and programming, ensuring data integrity, scalability, and efficiency.
Experience:
- Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data from various sources into our data warehouse or data lake.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement solutions that support business insights and decision-making.
- Optimize data pipelines and processes for performance, reliability, and scalability.
- Design and implement data models, schemas, and metadata to support data governance and analytics requirements.
- Monitor and troubleshoot data processing jobs, performance issues, and data quality problems.
- Ensure data security, privacy, and compliance with regulatory requirements.
- Stay updated on emerging technologies and best practices in data engineering
- and contribute to the continuous improvement of our data infrastructure and processes.
- Document technical specifications, data flows, and system architecture.
- Experience with data security in the data management domain specially at the level of data lakes.
- Experience with relational databases (e.g., MS SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra).
- Experience with cloud platforms (AWS, Azure, or GCP) and familiarity with DevOps
Skills
- Bachelor's degree in Computer Science, Software Engineering, or a related field.
- Strong knowledge of data structures (trees, graphs, hash tables, linked lists, etc.).
- Experience with database systems (MS SQL, NoSQL, PostgreSQL, MongoDB, etc.).
- Understanding of algorithm optimization and complexity analysis.
- Experience with big data frameworks (Hadoop, Spark) is a plus.
- Knowledge of cloud-based data storage solutions (AWS, Azure, Google Cloud) is beneficial.
- Strong problem-solving and analytical skills.
- Fluent in Arabic and English.