Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Manage a team of 5-10 software and data engineers focused on delivering large-scale distributed data processing and platform modernization using Apache Spark.
Own technical leadership for architecture, design, and optimization of scalable Spark-based data pipelines on cloud platforms (AWS/GCP).
Collaborate with cross-functional teams, lead troubleshooting of complex production issues, and ensure Agile SDLC and engineering governance adherence.
Minimum Requirements
Strong hands-on experience with Apache Spark including Spark Core, SQL, Structured Streaming, and performance tuning.
Proven experience leading engineering teams with delivery accountability of distributed data platforms.
Experience with cloud-native data ecosystems including Hadoop, Hive, Iceberg, AWS EMR, Glue, GCP Dataproc, BigQuery.
Work Experience Required: Not explicitly mentioned in the JD.
Ideal Candidate Profile
Mid-level engineering manager with balanced technical oversight and people management skills in big data distributed systems.
Experience designing and operating terabyte-to-petabyte scale Spark workloads with cloud deployments (AWS/GCP).
Ability to lead cross-functional collaboration and drive technical roadmaps and operational reliability for Spark-based data platforms.