Lead Databricks Engineer (Senior Software Engineer II)
NielsenMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessSpecialized Databricks platform role with moderate brand pull and metro location, medium competition.
Requires specialized Databricks/lakehouse platform and governance experience, limiting cross-industry transferability.
Requires deep Databricks, governance, IaC and FinOps expertise, so high shortlisting strictness.
Job Description
Structured overview of role & requirementsAbout This Role
Own and architect the end-to-end Databricks Lakehouse platform including workspace design, compute strategy, and multi-cloud deployment.
Define and enforce global data governance using Unity Catalog to ensure secure, governed, and audit-ready data access across units.
Lead platform reliability, automation (IaC, CI/CD), cost governance, and AI-native feature integration to scale a secure, cost-efficient data platform.
Minimum Requirements
Experience owning large-scale Databricks Lakehouse platforms and data governance via Unity Catalog.
Proficiency with Delta Lake architecture, Delta Live Tables, medallion architecture, and performance optimizations (Z-ordering, clustering).
Familiarity with Infrastructure-as-Code tools (Terraform/Databricks Asset Bundles) and CI/CD pipeline development.
Work Experience Required: Not explicitly mentioned in the JD.
Ideal Candidate Profile
Technical leader with cross-functional experience bridging platform engineering, data governance, and AI-enabled data architectures.
Strategic thinker focused on scalable, governed, and cost-optimized multi-cloud data platforms integrating AI-native capabilities.
Experienced in mentoring and enabling developer communities with standardized design, governance models, and service patterns.