Back
Metro mid-level Big Data role with common PySpark/Python/SQL skills increases candidate competition.
Big-data engineering skills (Spark, Python, SQL) are broadly transferable across industries.
Explicit 6+ years requirement plus mandatory Spark/PySpark, Hadoop, Python and SQL makes shortlisting strict.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Design, develop, maintain, and optimize highly scalable big data applications primarily using PySpark, Python, and SQL.
Evaluate domain, financial, and technical feasibility of big data solutions with key stakeholders.
Lead or actively participate in daily agile/scrum meetings and collaborate with QA and Operations to deliver error-free, timely software.
Engineering degree in computer science or related field preferred.
6+ years of software development experience with Hadoop ecosystem components including HDFS, Spark, Scala, PySpark.
At least 4+ years experience using Python or Scala, Spark, and SQL.
Strong knowledge of spark architecture, data frames, tuning, data warehousing, data modeling, Core Java, Linux, and scripting languages.
Demonstrated expertise in Apache Spark development, tuning, and implementation with strong data engineering background.
Experience working in agile environments and engaging collaboratively with cross-functional teams including QA and Operations.
Ability to evaluate and defend technical solutions with both business and technical stakeholders effectively.