Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessPopular mid-level Data Engineer role in Bengaluru with metro location and broad skill requirements.
Core data engineering skills are highly transferable across industries despite fintech risk domain preference.
Explicit 1–3 year requirement and mandatory data, Spark, SQL, backend, and cloud skills.
Job Description
Structured overview of role & requirementsAbout This Role
Build and maintain batch and streaming data pipelines ingesting data from multiple sources and transforming it for analytics and real-time decisioning.
Develop and own backend services and RESTful APIs serving internal teams and real-time decision paths, including Airflow DAGs and Spark jobs with performance tuning.
Implement monitoring, alerting, and data quality checks for data pipelines, debug production issues, and contribute to underlying identity graph data modeling.
Minimum Requirements
1-3 years professional software engineering experience, with exposure to data-intensive systems.
Strong programming skills in Python, Java, or Scala with production-quality, tested code experience.
Strong SQL skills including joins, window functions, aggregations, and query performance understanding.
Experience with distributed data processing frameworks (Spark preferred), backend service development, REST APIs, and familiarity with AWS cloud services (S3, EC2, managed databases).
Ideal Candidate Profile
Comfortable debugging complex distributed data systems and explaining root causes of problems.
Data modeling approach driven by business purpose and data use cases, not just technical implementation.
Interested in understanding full data processing stack costs, failures, and deployment aspects, including production monitoring and system stability.