Copy of Lead Databricks Engineer (Senior Software Engineer II)
NielsenMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessNiche Databricks platform specialization reduces applicants, but Bangalore metro and known employer keep competition medium.
Highly Databricks-centric platform and governance skills limit easy transfer across industries.
Requires specific Databricks, Unity Catalog, Delta Lake, IaC and FinOps expertise, making shortlisting highly strict.
Job Description
Structured overview of role & requirementsAbout This Role
Own end-to-end architecture and operational maturity of the Databricks Lakehouse platform, including workspace design, cluster policies, compute strategies, and multi-cloud deployments (AWS/Azure/GCP).
Define and enforce global data governance via Unity Catalog—covering catalogs, schemas, access controls, lineage, and audit logging—to ensure secure, compliant, and consistent metadata management.
Drive platform reliability, automation (Infrastructure-as-Code, CI/CD), cost governance, and AI-native capability integration, while enabling cross-functional teams and leading a Databricks developer community.
Minimum Requirements
Work Experience Required: Not explicitly mentioned in the JD.
Strong expertise in Databricks platform architecture including Unity Catalog, Delta Lake, Delta Live Tables, and medallion architecture.
Experience with multi-cloud environments (AWS, Azure, GCP) and Infrastructure-as-Code tools such as Terraform.
Proven capability in platform cost governance, monitoring, and automation targeting high availability (e.g., 99.99% uptime).
Ideal Candidate Profile
Technically proficient in managing complex, enterprise-scale Databricks environments with emphasis on governance and scalability.
Experienced in integrating AI-native features and supporting AI-driven data platform capabilities.
Skilled in cross-functional collaboration and community leadership to establish standards and enable multiple engineering and analytics teams.