Data Engineer

lxbfYeaa - الإمارات - Dubai United Arab Emirates

Overview of the role

 

As an Azure Data Engineer in our team, you will be responsible for governing and solution and assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. You will participate in new scope & requirements, break-fix work, testing, and support activities to meet the business needs. Implementing appropriate processes to drive high quality and sustainable solutions will be critical.

 

What you will do

  • Partners with the product owner, scrum master and solution architect to deliver solution.
  • Understanding the business requirements.
  • Responsible to review and analysis of business requirements and design technical solutions
  • Responsible for governance of the technology implementation of the solution designs
  • Work with internal and external implementation team members and partners to contribute to the development, testing and deployment of solutions.
  • Adheres to software development and maintenance standards by maintaining a comprehensive knowledge of internal and external development best practices.
  • Estimate and deliver multiple projects assignments and system change requests as per agreed resourcing and timelines with required quality.
  • You are required to do detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness, and business value.
  • Responsible for governance and implementing robust data pipeline using Microsoft toolset and Databricks
  • Responsible for creating reusable and scalable data pipelines


Skills

Required skills to be successful

  1. Expertise in Azure Stream Analytics is desirable
  2. Knowledge on Scala is desirable
  3. Strong analytic skills related to working with unstructured datasets

What equips you for the role

  • Expertise in data ingestion, data processing and analytical pipelines for big data, relational / non-relational databases, and data warehouse solutions
  • Experience in designing and hands-on development in cloud-based analytics solutions.
  • Designing and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services.
  • Build workflows using data from a wide variety of sources, including on premise databases and external data sources with rest APIs and harvesting tools.
  • Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
  • Hands-on experience with Agile software development
  • Thorough understanding of Azure / AWS Cloud Infrastructure offerings.
  • 8+ years of experience in Azure and Databricks.
  • Minimum 5+ implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
  • Bachelor’s degree in Computers or allied field of study.
  • Knowledge of SAP IS-Auto, SAP FICO, SAP BW/BO, Tableau, Power BI, Scala will be considered as added advantage.
  • Certification on Azure platform toolsets will be considered as added advantage

 

تاريخ النشر: ١٧ أغسطس ٢٠٢٤
الناشر: Bayt
تاريخ النشر: ١٧ أغسطس ٢٠٢٤
الناشر: Bayt