Senior Data Engineer (AWS / GCP, Airflow, Snowflake)

O specjalistce

Senior Data Engineer with 6+ years building and operating large-scale production data platforms on AWS and GCP: lakehouse architectures, Airflow orchestration, MongoDB, Snowflake and S3 data lakes. Most recently a core contributor to a multi-tenant HR/ATS data platform ingesting data from 20+ third-party systems for 50+ customer organisations: built an incremental sync that cut data freshness from daily to near-hourly, led ATS integrations and designed a configuration-driven MongoDB-to-S3/Snowflake export framework. Earlier maintained 50+ production ETL pipelines (~30% faster runtimes), ran 10+ FastAPI microservices on Cloud Run (release cycles cut by ~40%), supported 99.9% SLA compliance and helped migrate ~100 TB to BigQuery. Google Cloud certified (Data Engineer, Cloud Architect). Industries: HR tech, logistics, mining; no iGaming. Seeks a senior data engineering / data platform role.

Umiejętności

Doświadczenie zawodowe

Senior Data Engineer — cloud data platform company (India, hybrid) — 2024–2026: core contributor to a multi-tenant lakehouse platform; built hourly incremental ATS sync, led Workable/Lever integrations, designed reusable MongoDB export framework with dynamic Airflow orchestration Senior Associate, Cloud Data Engineer — analytics consultancy (India) — 2021–2024: 50+ production Airflow/Cloud Composer ETL pipelines, ~30% faster runtimes, 10+ FastAPI microservices, Datadog monitoring supporting 99.9% SLA Associate Consultant, Cloud Data Engineer — IT services company (Hyderabad, India) — 2019–2021: supported ~1,000 GCP pipelines, migrated ~100 TB to BigQuery with Beam/Dataflow, BigQuery disaster-recovery automation, Terraform modules, Looker Studio dashboards

Edukacja

B.Tech, Chemical Science & Technology — Indian Institute of Technology Guwahati, 2019 Google Cloud Certified: Professional Data Engineer; Professional Cloud Architect

Języki

English fluent