Back
Metro location, mid-level generalist big-data title, and common PySpark/Hadoop skills increase competition.
Big data engineering skills (PySpark, Spark, Hadoop) are highly transferable across industries.
Mandatory 6+ years plus specific PySpark/Hadoop/Spark/Scala technical requirements make shortlisting highly strict.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Evaluate technical, domain, and financial feasibility for Big Data solution ideas with key stakeholders.
Design, develop, and maintain scalable data processing applications primarily using PySpark, Python, and SQL.
Lead Apache Spark development including tuning, optimizing existing applications and delivering projects in an agile environment.
6+ years of software development experience with Hadoop ecosystem components including HDFS, Spark, Scala, PySpark.
At least 4+ years experience using Python or Scala with Spark and SQL.
Engineering degree in computer science or related field preferred.
Location: Pune or Bangalore; Excellent verbal, written and presentation skills; Knowledge of Core Java, Linux, SQL mandatory; background check required.
Experienced in developing and tuning Spark applications with deep understanding of Spark architecture and data frames.
Strong data engineering skills including knowledge of data warehousing and data modeling techniques.
Capable of working cross-functionally with QA, Operations and other teams to deliver error-free software on time, and actively participating in agile scrum processes.