Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, build, and operate large-scale batch and streaming data pipelines using Spark, Java, and Python.
Own data quality, observability, governance, and operational excellence for the pipelines you build.
Participate in system design reviews and mentor junior engineers, contributing to platform engineering when needed.
Minimum Requirements
5+ years professional software engineering experience with hands-on data engineering at scale.
Strong proficiency in Java, Python, and working knowledge of Spark is mandatory.
Bachelor's or Master's degree in Computer Science, Engineering, or related field, or equivalent experience.
Experience with Big Data ecosystem (Spark, Hadoop, Hive, Kafka) and data platform fundamentals including ETL pipeline design, data governance, and lakehouse architectures.
Ideal Candidate Profile
Experienced in translating data/business problems into scalable technical execution plans in newly formed or evolving teams.
Strong system design skills including trade-off evaluation, failure modes, scalability, and cost considerations.
Technical judgment and ownership mindset to operate autonomously in a high-responsibility environment with exposure to AI/GenAI and platform engineering concepts.