On-site Full Time
--
Small Cap Equity Advisors - 30 Yrs.

Job Details

Job Title: Senior Stream Processing Framework Specialist

Location: United Arab Emirates (Remote)

Employment Type: Full-Time

Work Arrangement: 100% Remote — Work From Home

About the Role

We are seeking an experienced Senior Stream Processing Framework Specialist to design, optimize, and maintain real-time data processing systems. The successful candidate will develop scalable streaming pipelines, improve processing performance, and ensure reliable data delivery across distributed platforms.

Key Responsibilities
  • Design and implement real-time data streaming pipelines and processing architectures.
  • Develop and optimize stream processing applications using Apache Flink, Kafka Streams, Spark Structured Streaming, or similar frameworks.
  • Monitor processing latency, throughput, data accuracy, and resource utilization.
  • Implement event-time processing, windowing, state management, and fault-tolerance mechanisms.
  • Troubleshoot data delays, processing failures, duplicate events, and pipeline bottlenecks.
  • Integrate streaming platforms with databases, data lakes, APIs, and cloud services.
  • Optimize checkpointing, state recovery, parallelism, and resource allocation.
  • Establish data quality controls, monitoring, alerting, and automated recovery procedures.
  • Collaborate with data engineering, software development, and DevOps teams to improve streaming reliability.
  • Document architecture decisions, operational procedures, and performance optimization standards.
Qualifications and Experience
  • Bachelor's degree in Computer Science, Data Engineering, Software Engineering, or a related field.
  • 5–8 years of experience in data engineering, distributed systems, or real-time stream processing.
  • Strong knowledge of streaming architectures, event-driven systems, and distributed data processing.
  • Practical experience with Apache Flink, Kafka Streams, Spark Structured Streaming, or equivalent frameworks.
  • Proficiency in Java, Scala, Python, or another relevant programming language.
  • Understanding of Kafka, event-time semantics, stateful processing, and fault tolerance.
  • Familiarity with cloud platforms, Docker, Kubernetes, and CI/CD pipelines.
  • Experience with data monitoring, pipeline testing, and performance tuning.
  • Strong analytical, troubleshooting, and communication skills.
  • Ability to work independently in a fully remote environment.
What We Offer
  • Competitive salary based on experience and qualifications.
  • 100% remote work with no routine office attendance.
  • Professional development and career advancement opportunities.
  • Collaborative environment focused on real-time data innovation and engineering excellence.
How to Apply

Submit your updated CV and a brief cover letter highlighting your stream processing expertise, data pipeline projects, and measurable performance improvements.

Email Subject: Application – Senior Stream Processing Framework Specialist (United Arab Emirates Remote)

  • Candidates should confirm applicable employment arrangements, residency requirements, and work authorization before accepting an offer.
Join our Telegram channel Get the latest jobs as soon as they are posted Join

Similar Jobs

Small Cap Equity Advisors - 30 Yrs.
Senior Stream Processing Framework Specialist