Lead Engineer- Platform & Data
Eightfold AI (company site, opens in a new tab)5+ yrsBengaluruOn-siteDirect career pageEst. 30–45 LPA
Posted 16h ago
Reach people at Eightfold AI
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Eightfold AI you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Architect and manage the data lakehouse platform, including Apache Iceberg table design and optimization.
- Deploy, operate, and performance-tune distributed analytical query engines (e.g., StarRocks) across multi-cloud environments.
- Build and maintain robust batch and streaming ETL/ELT pipelines with focus on data quality, observability, and scalable infrastructure using Kubernetes and Terraform.
Minimum Requirements
- 5+ years of experience designing, building, and operating large-scale data platforms and analytical systems.
- Hands-on expertise with Apache Iceberg/Hudi and Parquet file format optimizations.
- Experience with analytical query engines such as StarRocks, ClickHouse, or Trino in production environments.
- Experience operating multi-region cloud platforms on AWS, Azure, or Oracle Cloud Infrastructure; proficiency with Kubernetes, Terraform, Helm, and GitOps workflows.
Ideal Candidate Profile
- Experienced leader capable of mentoring engineers and driving platform initiatives end-to-end.
- Strong multi-cloud operational knowledge, especially in scalable, reliable data platforms and cost-efficient performance tuning.
- Technical ownership mentality with deep expertise in lakehouse architecture, data pipeline robustness, and Kubernetes autoscaling for data workloads.