Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead design, architecture, and optimization of enterprise-scale data pipelines using Azure Databricks, focusing on ACDP projects.
Implement and oversee end-to-end data pipelines using Medallion Architecture and Delta Lake ensuring data quality, governance, and scalability.
Drive CI/CD for Databricks environments with automation and infrastructure as code, while mentoring teams and collaborating with analysts and data scientists on AI/ML integrations.
Minimum Requirements
7-8+ years of experience in data engineering with deep expertise in Azure Databricks for big data processing.
Advanced proficiency in Python/PySpark, SQL, Scala, and strong distributed systems experience.
Experience with cloud-native solutions including AZ-900+ certification preferred and proven CI/CD implementation skills.
Work Experience Required: 7-8+ years in relevant data engineering roles.
Ideal Candidate Profile
Experienced in architecting scalable, cloud-native data pipelines on Azure with hands-on Databricks Spark expertise.
Skilled in infrastructure automation and deployment with Azure DevOps and infrastructure as code tools.
Capable of leading technical teams and translating complex business requirements into reusable data solutions enabling AI/ML use cases.