Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Own and execute large-scale data engineering projects involving big data processing using tools like Apache Spark and Hadoop.
Develop and optimize ETL pipelines ensuring high performance and cost-efficiency on cloud platforms, preferably AWS.
Manage and manipulate complex datasets (terabytes scale) to support data lake and data lakehouse architectures in production environments.
Minimum Requirements
Minimum 5 years of relevant data engineering experience.
Advanced proficiency in Python (including Pandas, NumPy) and strong SQL skills for complex data manipulation.
Hands-on experience with Apache Spark, Hadoop or equivalent distributed data processing systems.
Work Experience Required: 5+ years; Notice Period: Immediate/15 days or currently serving with last working day within 30 days.
Ideal Candidate Profile
Experienced in cloud-based data engineering, preferably with AWS development experience.
Strong operational focus on handling and optimizing large-scale datasets and ETL processes in production environments.
Deep understanding of data lake and data lakehouse architectures with knowledge of performance tuning and cost optimization.