Back
Strong Tier-1 brand but specialized Spark/Scala manager role reduces applicant density.
High—role demands specialized Spark/Scala and big-data pipeline leadership, limiting cross-industry interchangeability.
High due to explicit 13+ years requirement and mandatory Spark/Scala, cloud, and IaC experience.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Lead and manage a team of software engineers specializing in Spark/Scala to design, develop, and optimize large-scale streaming data pipelines in cloud and on-prem environments.
Oversee the full project lifecycle from design to testing and deployment, ensuring performance, cost efficiency, and compliance with data quality, governance, security, and privacy standards.
Collaborate with cross-functional teams including data scientists and business stakeholders to deliver reliable datasets and drive continuous improvement through adoption of new technologies.
13+ years of engineering experience with at least 6 years focused on Spark/Scala development.
Proficiency in Spark, Scala or Java programming, and experience with cloud platforms such as AWS EMR, Azure Databricks, or GCP Dataproc.
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field (or equivalent combination of education and experience).
Familiarity with CI/CD pipelines, Infrastructure as Code tools (Terraform, CloudFormation), and software development lifecycle including code repositories.
Experienced technical leader with strong expertise in Spark/Scala and large-scale streaming data engineering with hands-on development background.
Skilled in managing and optimizing complex distributed data processing systems across cloud and on-premises environments.
Collaborative operator capable of working with diverse technical teams (data science, QA, business) to deliver robust, scalable data solutions with emphasis on data quality and governance.