Overview of the role
As an Azure Data Engineer in our team, you will be responsible for governing and solution and assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. You will participate in new scope & requirements, break-fix work, testing, and support activities to meet the business needs. Implementing appropriate processes to drive high quality and sustainable solutions will be critical.
What you will do
- Partners with the product owner, scrum master and solution architect to deliver solution.
- Understanding the business requirements.
- Responsible to review and analysis of business requirements and design technical solutions
- Responsible for governance of the technology implementation of the solution designs
- Work with internal and external implementation team members and partners to contribute to the development, testing and deployment of solutions.
- Adheres to software development and maintenance standards by maintaining a comprehensive knowledge of internal and external development best practices.
- Estimate and deliver multiple projects assignments and system change requests as per agreed resourcing and timelines with required quality.
- You are required to do detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness, and business value.
- Responsible for governance and implementing robust data pipeline using Microsoft toolset and Databricks
- Responsible for creating reusable and scalable data pipelines
Skills
Required skills to be successful
- Expertise in Azure Stream Analytics is desirable
- Knowledge on Scala is desirable
- Strong analytic skills related to working with unstructured datasets
What equips you for the role
- Expertise in data ingestion, data processing and analytical pipelines for big data, relational / non-relational databases, and data warehouse solutions
- Experience in designing and hands-on development in cloud-based analytics solutions.
- Designing and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services.
- Build workflows using data from a wide variety of sources, including on premise databases and external data sources with rest APIs and harvesting tools.
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
- Hands-on experience with Agile software development
- Thorough understanding of Azure / AWS Cloud Infrastructure offerings.
- 8+ years of experience in Azure and Databricks.
- Minimum 5+ implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
- Bachelor’s degree in Computers or allied field of study.
- Knowledge of SAP IS-Auto, SAP FICO, SAP BW/BO, Tableau, Power BI, Scala will be considered as added advantage.
- Certification on Azure platform toolsets will be considered as added advantage