Senior Data Engineer Python, PySpark & GCP
ZetamicronMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable ETL/ELT pipelines using Python and PySpark for large volumes of structured and unstructured data.
Optimize data processing workflows and Spark jobs for performance, scalability, and cost efficiency in cloud environments (AWS, Azure, GCP).
Implement data ingestion, cleansing, validation, transformation, quality checks, and monitor data pipelines with alerting mechanisms.
Minimum Requirements
6-10 years of relevant work experience in data engineering.
Strong proficiency in Python, PySpark, and complex SQL development including stored procedures and views.
Experience with cloud-native data services on AWS, Azure, or GCP.
Onsite work location mandatory: Bengaluru or Hyderabad.
Ideal Candidate Profile
Experienced in handling large-scale data processing workflows and optimizing Spark jobs within cloud platforms.
Able to collaborate effectively with business stakeholders, analysts, and architects to translate data requirements into technical solutions.
Familiar with Agile development practices, CI/CD pipelines, version control (Git), and production troubleshooting in data engineering contexts.
