Senior Data Engineer
Anblicks (company site, opens in a new tab)6–8 yrsHyderabadOn-siteDirect career pageEst. 18–28 LPA
Posted on 24 Sept
Reach people at Anblicks
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Anblicks you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, develop, and optimize scalable data pipelines and Lakehouse platforms using Databricks, PySpark, Python, SQL, and cloud technologies.
- Lead performance tuning, Spark optimization, and implement engineering standards for data solutions focusing on scalability, reliability, and cost-effectiveness.
- Drive data quality, governance, security practices and contribute to architectural decisions in large-scale, cloud-native data environments.
Minimum Requirements
- 6–8 years of Data Engineering experience, including 5+ years of hands-on Databricks experience.
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems or related field.
- Strong expertise in Python, PySpark, SQL, distributed data processing, and experience with AWS services like S3, EMR, Glue, Lambda, ECS/EKS, Redshift, IAM.
- Experience with Lakehouse architecture, Spark optimization, scalable data modeling, CI/CD, automated testing, and cloud-native data platforms.
Ideal Candidate Profile
- Experienced in designing and operating large-scale cloud data platforms with deep expertise in Databricks and Spark performance tuning.
- Able to lead technical initiatives and architectural decisions focusing on modern DataOps and Data Product practices.
- Comfortable working in Agile, globally distributed, cross-functional teams with strong stakeholder management and problem-solving skills.