Sr Data Engineer - 100% Remote
VGreenTEK (company site, opens in a new tab)5+ yrsTrivandrumRemoteDirect career pageEst. 12–20 LPA
Posted on 28 Sept
Reach people at VGreenTEK
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at VGreenTEK you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Own and execute large-scale data engineering projects involving big data processing using tools like Apache Spark and Hadoop.
- Develop and optimize ETL pipelines ensuring high performance and cost-efficiency on cloud platforms, preferably AWS.
- Manage and manipulate complex datasets (terabytes scale) to support data lake and data lakehouse architectures in production environments.
Minimum Requirements
- Minimum 5 years of relevant data engineering experience.
- Advanced proficiency in Python (including Pandas, NumPy) and strong SQL skills for complex data manipulation.
- Hands-on experience with Apache Spark, Hadoop or equivalent distributed data processing systems.
- Work Experience Required: 5+ years; Notice Period: Immediate/15 days or currently serving with last working day within 30 days.
Ideal Candidate Profile
- Experienced in cloud-based data engineering, preferably with AWS development experience.
- Strong operational focus on handling and optimizing large-scale datasets and ETL processes in production environments.
- Deep understanding of data lake and data lakehouse architectures with knowledge of performance tuning and cost optimization.