Senior Data Engineer

مصر - Egypt
A rapidly-growing company that is dabbling extensively in retail and institutional brokerage services is looking for a Senior Data Engineer. The engineer should have a thorough understanding of business and possess excellent analytical abilities, allowing them to provide the anticipated benefits to the company. The company’s intuitive trading platform is enabling clients across all walks of life to make major financial decisions by providing them with the highest quality investment opportunities. Candidates who are eager to cinch new heights and build an enviable career would be an ideal fit for this job.Job Responsibilities:Combine strong data modeling, integration, and data engineering abilities in Python and SQLUtilize the Azure stack and stay informed about the Data team's engineering effortsPossess an opinion on information architecture and how it should be developed to meet functional needs and company goalsParticipate actively in the data transformation effort by liaising with the teams responsible for reporting, data science, governance, and business partnershipsWork with the newest technologies in a cloud-based environment in a multidisciplinary team comprising analysts, data scientists, data engineers, and SMEs to improve the caliber of data-based decision-making throughout the companyParticipate in the creation of the platform and support for data analytics, guaranteeing standardized and simple data exchange and accessBecome familiar with and utilize Databricks, Azure Events Hub, Azure Data Lake, and SynapseAssist with the development, construction, and upkeep of data pipelines for various data sources and communicate with system ownersBe proficient at ingesting and transforming data in real-time to meet our use casesMake that all data interfaces are consistent with governance and provide high-quality data tools and capabilitiesMake certain that the transformation backlog is sent to the data products, derived tables, and source systemsAnalyze complicated data and present your findingsCollaborate closely with other senior and lead engineers to support BAU efforts and develop new productsTroubleshoot BAU-related problems, create a JIRA, and work on process improvementsEncourage others to build on your work and share your knowledge with your teammatesEngage in on-call duties to assist with any significant malfunctions.Engage in a rotating on-call schedule for production supportAssist with sporadic data requests and operational problemsJob Requirements:Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)At least 10+ years of relevant experience as a data engineer10+ years of experience in a data engineering capacity with exceptional hands-on abilities Data Engineering certification as an Azure Data Engineer or Google Certified ProfessionalAbility to oversee initiatives on an individual basisExtensive knowledge of Python, Pyspark, and SQLWorking knowledge of and comprehension of Azure Databricks, Azure Events Hub, Azure Data Lake, and Azure SynapseStrong experience in data warehousing, big data processing, ETL workflow design, and data pipeline architectureProven background in creating Python frameworksExtensive background in analytics solutions and data mapping for business processing.Substantial expertise in the concepts of corporate data modelingStrong debugging and troubleshooting abilitiesExcellent English communication skills, both spoken and written
تاريخ النشر: اليوم
الناشر: Wuzzuf .com
تاريخ النشر: اليوم
الناشر: Wuzzuf .com