Lead Databricks Engineer (Senior Software Engineer II)
NielsenMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessSpecialized Databricks platform role reduces applicant pool, but seniority plus established global employer and metro hiring increase competition.
Deep Databricks lakehouse and platform architecture expertise makes cross-industry mobility limited.
Explicit 8+ years, mandatory Databricks/Delta/Spark/Unity Catalog and Terraform increases filtering stringency.
Job Description
Structured overview of role & requirementsAbout This Role
Own end-to-end architecture and operational maturity of Nielsen's Databricks Lakehouse platform, including workspace, Unity Catalog, and multi-cloud deployment.
Define and enforce data governance, platform standards (Delta Lake, DLT, medallion architecture), reliability via automation, and cost governance across the Databricks environment.
Lead governed AI enablement within the platform, mentor Databricks developers, and collaborate cross-functionally to scale secure, cost-efficient data capabilities.
Minimum Requirements
8–10+ years in senior or lead data engineering/platform roles with direct ownership of production Databricks environments.
Proven expertise in Databricks platform engineering: Unity Catalog, Delta Lake, Delta Live Tables, cluster and compute policy design.
Hands-on experience with Apache Spark, Python, SQL; Infrastructure-as-Code automation via Terraform or Databricks Asset Bundles; CI/CD pipelines.
Work Experience Required: 8–10+ years relevant experience explicitly mentioned. No notice period mentioned.
Ideal Candidate Profile
Experienced data platform architect comfortable operating at the intersection of platform engineering, data governance, and business enablement.
Technical leader skilled in large-scale, multi-tenant Databricks deployments, with strategic foresight on cost governance and operational reliability.
Able to engage both technical and non-technical stakeholders clearly on platform decisions using concise, bottom-line-up-front communication style.