Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessMetro location, common mid-level Data Engineer title, 3–6 year target band, broad Hadoop/Spark skillset.
Data engineering skills (Spark, Hadoop, Python) are broadly transferable across industries.
Mandatory 5+ years and specific Hadoop/Spark/Python tech stack required.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable data processing applications using Hadoop ecosystem components such as Spark, Hive, and HDFS.
Deliver big data projects involving Spark, Python, SQL, HQL with a focus on performance tuning and code quality.
Collaborate with QA, operations, and various teams to ensure timely delivery of error-free software in an agile environment.
Minimum Requirements
5+ years of software development experience with Hadoop framework components (HDFS, Spark, Sqoop, Hive, HQL, PySpark, Scala).
5+ years experience using Python, SQL, and shell scripting.
Bachelor's degree in Computer Science or related field.
Location: Bangalore or Pune, India.
Ideal Candidate Profile
Strong expertise in Spark architecture, data frames, and application tuning indicating deep technical proficiency in big data processing.
Experience working in agile/scrum methodologies collaborating across QA, operations, and development teams for end-to-end software delivery.
Process-oriented with strong analytical and problem-solving skills to contribute effectively to performance-critical big data projects.