Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design and implement scalable batch and streaming data pipelines using PySpark, Apache Kafka, Databricks Workflows, and Delta Lake on Databricks.
Architect and optimize enterprise-scale data ingestion, transformation, and event-driven processing frameworks aligned with business and analytical goals.
Lead data quality, validation, governance, and operational monitoring practices; mentor team members on best practices and troubleshoot complex data platform issues.
Minimum Requirements
Mandatory skills: PySpark, Apache Kafka, Databricks Workflows, Delta Lake on Databricks.
Additional skills: AWS CLI.
Work Experience Required: Not explicitly mentioned in the JD.
Location: Noida, UP, India.
Ideal Candidate Profile
Experienced in architecting and optimizing data pipelines for large-scale, distributed data environments using lakehouse architecture principles.
Strong accountability for delivery excellence, including data quality, observability, and platform engineering standards.
Proven ability to lead and mentor teams, collaborate with multi-disciplinary stakeholders, and handle complex data platform challenges effectively.