Data Engineer (PySpark, Kafka, Databricks)

About the team

We are a focused engineering team of 5 to 9 people at a multi-product tech SaaS company. We work across personalization, recommendation, fraud detection, and some GenAI, through real-time, near-real-time, and batch pipelines. The team is a blend of Python backend engineers, ML engineers, QA (manual and automation), a data engineer, and data scientists. Our shared mandate is to take experimentation from our data scientists and turn it into
robust, production-grade systems, either as standalone services or integrated into wider platforms.
The role
You will build the data pipelines that power our experimentation and production systems, the backbone behind fraud detection, recommendations, and personalization. You will work primarily with Kafka (sometimes Flink), Spark on Databricks, and Airflow, modelling and optimizing data for both experimentation and production serving, and partnering closely with data scientists and backend engineers on data contracts and reliability.

Responsibilities

• Build and operate batch and streaming data pipelines (structured & unstructured data)
• Work primarily with Kafka, Spark on Databricks, and Airflow
• Model and optimize data for both experimentation and production serving
• Partner with data scientists and backend engineers on data contracts and reliability
• Own pipeline quality: testing, monitoring, and performance
• Take part in the teams on-call rotation for the pipelines you build and operate

Requirements

• 3+ years of data engineering or software engineering for data
• Strong Python, including PySpark
• Kafka and stream processing
• Databricks experience
• Airflow or similar orchestration tools
• Strong SQL and data modeling, plus solid relational database skills
• Software engineering mindset
• Fluent spoken English, as you’ll work with an international team and all interviews will be conducted in English.

Nice to have

• Flink
• ML Feature stores
• MLOps and ML pipeline exposure
• Docker and Kubernetes
• SaaS or high-scale product domain experience

Why join us

• Work on high-scale, high-throughput systems
• Broad range of technologies, stacks, and problems
• Contribute to turning experimentation into production systems
• A strong engineering culture that values technical depth and ownership
• Flexibility through hybrid and remote working
• A distributed team across Dubai and Europe

You will get
A position in a product development company with a dynamic environment and several concurrent projects;
Continuous self-improvement and growth, including budget for certifications and courses;
Competitive salary plus financial bonuses;
Medical insurance coverage;
Company prepaid AI agent;
Wellbeing package: online-yoga classes, Yakaboo, BetterMe App: Health Coaching, BetterMe App: Mental Health;
Corporate events and fun team-building activities.
Remote-first culture
Interview Stages
HR Interview (30-45 minutes) — Initial conversation to discuss your experience, career goals, and cultural fit.
Technical Interview (1 hour) — In-depth technical interview covering relevant skills.
Final Interview (1,5 hour) — A comprehensive discussion with the team, focusing on role-specific competencies and alignment with company values.
Reference check & Job Offer