Overview Of The Role:
- The Data Engineer is responsible for turning complex data from SAP and non-SAP sources into valuable business insights. This role involves participating in requirement assessments, implementing high-quality data solutions, and supporting various business needs. Success entails effective collaboration with product and development teams to deliver scalable, governed data solutions swiftly. The Data Engineer plays a key role in maintaining the quality of data insights solutions and ensuring alignment with business objectives.
What You Will Do:
Technical Development and Implementation
- Partner with product owners, scrum masters, and solution architects to deliver solutions.
- Review and analyze business requirements to design technical solutions.
- Collaborate with implementation team members and partners internally and externally to develop, test, and deploy solutions.
- Adhere to software development and maintenance standards by understanding development best practices.
- Implement robust data pipelines using the Microsoft toolset and Databricks.
- Create reusable and scalable data pipelines.
- Estimate and deliver multiple project assignments and system change requests within agreed resourcing and timelines.
Data Analysis and Governance
- Govern solutions and assess complex new data sources with various SAP and non-SAP systems.
- Analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
- Govern the technology implementation of solution designs.
Skills
Required Skills To Be Successful:
- Expertise in data ingestion, data processing, and analytical pipelines for big data and data warehouse solutions.
- Experience in cloud-based analytics solutions, particularly Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.
- Strong analytic skills with experience handling unstructured datasets.
- Thorough understanding of DevOps processes, CI/CD, and Infrastructure as code.
What Equips You For The Role:
- 8+ years of experience in Azure and Databricks.
- Minimum 5+ years in implementing analytics capabilities from conceptualization to delivery on the Azure platform.
- Bachelor's degree in Computer Science or a related field.
- Knowledge of SAP BW/BO, Tableau, Power BI, and Scala is advantageous.
- Certification on Azure platform toolsets is a beneficial addition.