IN_Manager__Databricks Data Engineer_GCC_Advisory_Gurgaon
PwC India (company site, opens in a new tab)6–10 yrsGurugramOn-siteDirect career pageEst. 18–30 LPA
Posted 11h ago
Reach people at PwC India
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at PwC India you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, build, and maintain scalable, high-performance data pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, Delta Lake and cloud services.
- Optimize Spark jobs for performance and cost efficiency while ensuring data quality, lineage, governance, and compliance with security standards.
- Collaborate with analytics, AI/ML, and business teams; provide production support, document technical designs, and mentor junior engineers.
Minimum Requirements
- 6+ years of experience as a Data Engineer with strong expertise in Databricks and Apache Spark (PySpark, Spark SQL).
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field with 60% or above.
- Advanced SQL skills; experience with Delta Lake, data warehousing, ETL/ELT patterns, and at least one cloud platform (Azure/AWS/GCP).
- Work Experience Required: 6-10 years. Notice period: Not explicitly mentioned in the JD.
Ideal Candidate Profile
- Experienced in Databricks Lakehouse architecture and data engineering best practices including CI/CD for data pipelines.
- Familiarity with data governance tools like Unity Catalog and streaming/data ingestion frameworks such as Auto Loader.
- Skilled in working within Agile teams and able to collaborate closely with data scientists, analysts, and architects on AI/ML workloads.