Data platform Engineer
UST (company site, opens in a new tab)6+ yrsHyderabadOn-siteDirect career pageEst. 18–30 LPA
Posted on 16 Sept
Reach people at UST
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at UST you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Architect and manage scalable cloud data infrastructure on AWS including services like S3, EMR, Glue, Lambda, Redshift, EC2, and IAM.
- Build, optimize, and maintain robust ETL/ELT data pipelines for batch and streaming data processing using Python and PySpark.
- Implement infrastructure as code using Terraform and set up CI/CD pipelines for data engineering workflows, ensuring data quality, security, and high availability.
Minimum Requirements
- Minimum 6+ years of experience in data platform engineering or related roles.
- Strong expertise in AWS services such as S3, EMR, Glue, Redshift, Lambda, IAM, EC2, and CloudWatch.
- Proficiency in Python and PySpark for ETL/ELT development; experience with Terraform for infrastructure as code.
- Familiarity with orchestration tools like Airflow, SQL and relational/non-relational databases, version control with Git, and CI/CD pipelines.
Ideal Candidate Profile
- Experienced senior engineer capable of owning end-to-end data pipeline architecture and cloud infrastructure management.
- Technical operator comfortable with managing large-scale AWS cloud environments and automating infrastructure deployment using Terraform.
- Collaborates effectively with data scientists, analysts, and stakeholders to translate data requirements into reliable, secure solutions.