Overview Of The Role:

• As a Senior Data Engineer in the Data and Analytics team, your role is pivotal in converting complex data landscapes into actionable business insights. You will evaluate diverse data sources from both SAP and non-SAP systems and convert these into business-ready datasets. You will be crucial in the development and support of integrating these data streams into our Azure Data platform, ensuring the data supports our business intelligence and analytics goals.

What You Will Do:

Prototyping and Solution Design

• Design, document, develop, implement, and test rapid prototypes to showcase data value for extended business audiences.
• Engage in early-stage design discussions and feature definition activities to shape future projects.
• Convert business requirements into Technical Specification Documents (TSDs) and Functional Specification Documents (FSDs).

Data Pipeline Management

• Build and manage reusable and scalable data pipelines, optimizing data flows for efficiency and effectiveness.
• Assist with regular reporting queries and support developers using tools such as Alteryx, Power BI, and Azure.
• Develop and support integration of new data streams into Azure Data platform ensuring accessibility, reliability, and structure.

Collaboration and Leadership

• Act as a team player, facilitating collaboration and knowledge sharing across engineering teams.
• Support integration of proven prototypes into core intelligence products, enhancing project delivery.
• Adapt to agile and waterfall methodologies, guiding teams through dynamic project environments for timely deliveries.

Skills

Required Skills To Be Successful:

• Expertise in Azure Data Factory, Databricks, and Azure Event Hubs.
• Proven experience in constructing and refining Big Data pipelines, architectures, and datasets.
• Strong analytical abilities for deriving insights from unstructured datasets.
• Experience with Azure DevOps for deploying ADF pipelines, ensuring continuous integration and delivery.

What Equips You For The Role:

• 10+ years of experience in data engineering, specifically within Azure and Databricks environments.
• Bachelor's or Master's degree in Data Management, Information Systems, Business, Computer Science, or related fields.
• Certifications in Azure Data Fundamentals and Databricks are preferred.
• Robust knowledge and experience with both relational and non-relational databases, and expertise in Python, PySpark, and SQL.