Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Architect and develop a self-serve data platform-as-a-product integrating OSS tools, proprietary services, and cloud/SaaS infrastructure.
Operate and scale distributed systems processing petabytes of data daily on multi-region Kubernetes infrastructure ensuring elasticity and fault tolerance.
Optimize performance and ensure observability and data quality for large scale batch and real-time streaming data workflows with automated SLA enforcement.
Minimum Requirements
7–10 years experience building, optimizing, and operating production data platforms.
Strong expertise in data engineering fundamentals including data modeling, partitioning, query optimization, and data lake architecture (Iceberg, Polaris catalog).
Hands-on experience with distributed compute frameworks Spark (PySpark/Scala), Flink streaming, orchestration with Airflow, data transformation with DBT, and data quality validation frameworks.
Proficiency in Kubernetes platform development, cloud infrastructure (GKE multi-region clusters, GCS), programming (Python, PySpark, Scala), and IaC (Terraform, Helm, GitOps).
Ideal Candidate Profile
Experienced senior engineer comfortable bridging open-source tools and proprietary cloud services into unified production-grade data platform infrastructure.
Demonstrated ability to operate large-scale distributed data systems with multi-region Kubernetes and autoscaling.
Skilled in integrating telemetry and observability frameworks and enforcing data SLAs/SLOs with automated incident management for 24/7 platform uptime.