Data Platform Engineer
UNAVAILABLE5+ yrsOn-siteDirect career pageEst. 12–22 LPA
Posted on 18 Sept
Reach people at UNAVAILABLE
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at UNAVAILABLE you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Automate and orchestrate Databricks Jobs/Workflows and CI/CD pipelines for data workloads including batch and SQL.
- Implement and operate Unity Catalog at scale, including catalog/schema provisioning, RBAC standardization, security, audit, and migration processes.
- Maintain high data platform reliability and data quality by defining SLOs, implementing quality checks, and leading incident response efforts.
Minimum Requirements
- 5–8+ years of experience in DataOps for data platforms with senior-level expertise.
- Hands-on experience with Databricks components: Workflows/Jobs, Delta Live Tables, Delta Lake, Repos, SQL Warehouses.
- Strong skills in Unity Catalog automation including grants and migration, Terraform with Databricks provider, Databricks SDK/CLI/REST, and CI/CD tools like GitHub Actions or Azure DevOps.
- Proficiency in Python and SQL, with basic understanding of Spark job configuration and tuning.
Ideal Candidate Profile
- Experienced in building automated, parameterized, and templatized data workflows and governance at scale on Databricks.
- Skilled in infrastructure-as-code automation and governance for complex data platforms, including security enforcement and audit capabilities.
- Capable of driving operational excellence with focus on data pipeline SLAs, incident management, and data quality assurance.