Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design and build scalable, reusable data pipelines and curated datasets on AWS-based lakehouse architecture using batch and streaming data.
Develop and optimize open table format datasets (e.g., Apache Iceberg) focusing on schema evolution, partitioning, and performance across multiple query engines and cloud providers.
Implement and standardize medallion layered ingestion and transformation patterns (raw, silver, gold) ensuring discoverability, trustworthiness, and governance integration of datasets.
Minimum Requirements
Experience with AWS-native services like S3, Glue, Kinesis and orchestration tools such as Airflow.
Hands-on experience with open table formats such as Apache Iceberg or similar for transactional lakehouse implementations.
Work Experience Required: Not explicitly mentioned in the JD.
Location requirement: Hyderabad or Bangalore.
Ideal Candidate Profile
Experienced in building data platforms that leverage open standards to enable cloud-agnostic and multi-engine interoperability.
Familiar with medallion data architecture and implementing robust data ingestion and transformation pipelines in batch and streaming contexts.
Capable of driving engineering standards across a platform and integrating metadata, lineage, and governance for data trust and discoverability.