Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessPopular mid-level data role in Bangalore with broad cloud/streaming requirements and 4+ years, making competition high.
Core data engineering skills are transferable, though transportation domain knowledge is beneficial.
Mandatory 4+ years and core techs (Python, Spark, SQL, Airflow, cloud) create strict filtering.
Job Description
Structured overview of role & requirementsAbout This Role
Own and scale backend data infrastructure supporting real-time optimization, advanced analytics, and machine learning applications.
Design, implement, and maintain robust, scalable data pipelines for batch and real-time processing using Spark and other tools.
Collaborate cross-functionally to translate data requirements into scalable solutions and drive architectural decisions on pipeline reliability and scalability.
Minimum Requirements
4+ years of experience in backend data engineering or infrastructure-focused software development.
Proficiency in Python and solid understanding of SQL.
Experience designing and operating scalable, low-latency batch and streaming data pipelines.
Degree in Computer Science, Engineering, or related field.
Ideal Candidate Profile
Experienced with cloud-native data platforms, preferably with hands-on use of GCP services and containerization (Docker, Kubernetes).
Strong skills in building and maintaining data lakes, pipelines, and developer tooling, with familiarity in orchestration tools like Airflow and modern CI/CD.
Demonstrated ability to optimize ETL/ELT workflows and maintain high data quality and pipeline reliability at scale.