Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessNiche senior Spark architect role with strong technical barriers lowers candidate density despite metro location.
High because Spark, distributed systems, and platform architecture skills are specialized and industry-specific.
High due to explicit 10+ years requirement and mandatory deep Spark, cloud, and architecture expertise.
Job Description
Structured overview of role & requirementsAbout This Role
Design and architect scalable, resilient data processing solutions using Apache Spark and cloud platform technologies.
Provide technical leadership and guidance on Spark-based batch and streaming data processing to multiple engineering teams, including performance tuning and operational best practices.
Collaborate with stakeholders to align architecture with business needs, support platform modernization, and mentor engineers on distributed systems and Spark development.
Minimum Requirements
10+ years of experience in software engineering, data engineering, or distributed systems development.
Strong hands-on expertise with Apache Spark (Spark SQL, Structured Streaming, DataFrames, Dataset APIs) and Spark optimization techniques.
Proficiency in Scala, Java, or Python programming languages.
Experience deploying Spark solutions on AWS and/or GCP cloud platforms.
Ideal Candidate Profile
Demonstrated ability to lead architecture and technical direction for large-scale distributed data platforms.
Experienced individual contributor comfortable working across multiple engineering teams and influencing technology selection and standards.
Strong background in cloud-native architectures and modern data platform technologies with hands-on experience in Spark performance optimization and streaming analytics.