Lead Databricks Engineer (Senior Software Engineer II)
Nielsen (company site, opens in a new tab)8+ yrsMumbaiHybridDirect career pageEst. 30–48 LPA
Posted on 25 Sept
Reach people at Nielsen
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Nielsen you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Own end-to-end architecture and operational maturity of Nielsen's Databricks Lakehouse platform, including workspace, Unity Catalog, and multi-cloud deployment.
- Define and enforce data governance, platform standards (Delta Lake, DLT, medallion architecture), reliability via automation, and cost governance across the Databricks environment.
- Lead governed AI enablement within the platform, mentor Databricks developers, and collaborate cross-functionally to scale secure, cost-efficient data capabilities.
Minimum Requirements
- 8–10+ years in senior or lead data engineering/platform roles with direct ownership of production Databricks environments.
- Proven expertise in Databricks platform engineering: Unity Catalog, Delta Lake, Delta Live Tables, cluster and compute policy design.
- Hands-on experience with Apache Spark, Python, SQL; Infrastructure-as-Code automation via Terraform or Databricks Asset Bundles; CI/CD pipelines.
- Work Experience Required: 8–10+ years relevant experience explicitly mentioned. No notice period mentioned.
Ideal Candidate Profile
- Experienced data platform architect comfortable operating at the intersection of platform engineering, data governance, and business enablement.
- Technical leader skilled in large-scale, multi-tenant Databricks deployments, with strategic foresight on cost governance and operational reliability.
- Able to engage both technical and non-technical stakeholders clearly on platform decisions using concise, bottom-line-up-front communication style.