Back
Strong Tier-1 brand, mid-level generalist data role, metro location, and common skillset.
Core data engineering skills transfer across industries, though payments/transaction experience is preferred.
Explicit 6+ years plus mandatory Spark, Kafka, NiFi, production distributed systems, and cloud experience.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Develop, test, validate, and maintain scalable batch and real-time data processing applications using Apache Spark, Kafka, and NiFi.
Build validation suites and reusable frameworks to support distributed, fault-tolerant systems handling large data volumes and streaming architectures.
Optimize performance, scalability, and reliability of distributed data platforms; participate in troubleshooting, code reviews, and mentor junior engineers.
Bachelor's degree in Computer Science, Engineering, or related technical field.
6+ years experience in software deployment, validation, testing, and development on large-scale data-intensive applications.
Strong expertise with Apache Spark (Batch and Structured Streaming), Apache Kafka, and Apache NiFi.
Proficiency in Scala, PySpark or Python, strong SQL and data modeling skills, and experience with distributed storage systems (e.g., Apache Ozone, Ceph, HDFS).
Experienced in operating production-grade distributed data systems in cloud or hybrid-cloud environments with event-driven architectures.
Comfortable contributing to architectural design, engineering standards, CI/CD pipelines, and engineering automation frameworks.
Skilled at collaborating with cross-functional teams to translate business and technical requirements into scalable and performant data solutions.