Back
Medium—niche Hadoop/CA7 skills but common Data Engineer title and Pune metro raise applicant competition.
Medium—core data engineering skills transfer, but on-prem Hadoop and CA7 narrow industry applicability.
High—explicit 7–10 years and mandatory Hadoop, Spark, Python, and CA7/Control-M requirements.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Lead design, development, and maintenance of scalable, on-premises big data pipelines and processing systems.
Own architectural decisions and set technical standards for data engineering solutions.
Mentor and support other data engineers, including code and design reviews and problem-solving.
7–10 years of experience in data engineering with proven technical leadership (design ownership, mentoring).
Strong hands-on experience with Python, Apache Spark, and Hadoop ecosystem (Hive, HDFS, Impala) in on-premises environments.
Experience with enterprise job scheduling/orchestration tools like CA7 or Control-M.
Exposure to AI/ML concepts with willingness to learn; strong understanding of SQL and ETL processes.
Technical leader comfortable owning architecture and guiding development teams in complex on-premises big data environments.
Experienced in optimizing large-scale distributed data processing workflows using Python, Spark, and Hadoop components.
Collaborates effectively with cross-functional teams including data scientists and business stakeholders to deliver reliable data solutions.