spinhireSenior Data Engineer (AWS / GCP, Airflow, Snowflake)
Относно специалиста
Senior Data Engineer with 6+ years building and operating large-scale production data platforms on AWS and GCP: lakehouse architectures, Airflow orchestration, MongoDB, Snowflake and S3 data lakes. Most recently a core contributor to a multi-tenant HR/ATS data platform ingesting data from 20+ third-party systems for 50+ customer organisations: built an incremental sync that cut data freshness from daily to near-hourly, led ATS integrations and designed a configuration-driven MongoDB-to-S3/Snowflake export framework. Earlier maintained 50+ production ETL pipelines (~30% faster runtimes), ran 10+ FastAPI microservices on Cloud Run (release cycles cut by ~40%), supported 99.9% SLA compliance and helped migrate ~100 TB to BigQuery. Google Cloud certified (Data Engineer, Cloud Architect). Industries: HR tech, logistics, mining; no iGaming. Seeks a senior data engineering / data platform role.
Умения
трудов стаж
Core contributor to a multi-tenant lakehouse platform; built hourly incremental ATS sync, led Workable/Lever integrations, designed reusable MongoDB export framework with dynamic Airflow orchestration
50+ production Airflow/Cloud Composer ETL pipelines, ~30% faster runtimes, 10+ FastAPI microservices, Datadog monitoring supporting 99.9% SLA
Supported ~1,000 GCP pipelines, migrated ~100 TB to BigQuery with Beam/Dataflow, BigQuery disaster-recovery automation, Terraform modules, Looker Studio dashboards
образование
B.Tech, Chemical Science & Technology — Indian Institute of Technology Guwahati, 2019 Google Cloud Certified: Professional Data Engineer; Professional Cloud Architect
Езици
English fluent