





Metro location, broad data stack requirements, and a common data-engineer title increase competition.
Core data engineering skills (PySpark, Kafka, SQL) are broadly transferable across industries.
Mandatory degree plus specific technologies (Python, PySpark, Kafka) enforce strict screening filters.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Develop and maintain Python code for data manipulation and application development.
Design and build high-performance PySpark data transformation jobs on large-scale datasets.
Build and maintain real-time data streaming pipelines using Apache Kafka and related technologies.
Proficiency in Python, PySpark, and Apache Kafka including Kafka Connect and Kafka Streams.
Experience with Hadoop ecosystem components like HDFS, YARN, and Hive.
Strong SQL skills with experience in relational databases such as PostgreSQL or SQL Server.
Educational Qualification: B.Tech or M.Tech degree. Work Experience Required: Not explicitly mentioned in the JD.
Experienced in handling large-scale data processing and streaming architectures.
Comfortable working with multiple data technologies including Hadoop, Kafka, and relational databases.
Capable of collaborating via version control systems like Git in a team environment.