Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Develop, test, validate and maintain scalable batch and real-time data processing applications using Apache Spark, Kafka, and NiFi.
Build validation suites and reusable frameworks to support fault-tolerant distributed data systems handling large data volumes.
Collaborate across teams to design solutions, optimize system performance, and ensure operational excellence for production-grade distributed systems.
Minimum Requirements
Bachelor's degree in Computer Science, Engineering or related technical field.
6+ years of hands-on experience with software deployment, testing, validation, and development of large-scale data-intensive applications.
Strong expertise in Apache Spark (Batch and Structured Streaming), Apache Kafka, and Apache NiFi.
Proficiency in Scala, PySpark or Python; plus experience with distributed storage systems like Apache Ozone, Ceph, HDFS, or cloud object stores.
Ideal Candidate Profile
Experience operating and troubleshooting production-grade distributed systems in cloud or hybrid-cloud environments.
Background in building scalable, resilient data pipelines and validation platforms using event-driven architectures.
Able to contribute to architecture, code reviews, CI/CD processes, and mentor junior engineers within complex, data-driven technology environments.