EY - GDS Consulting - AI and DATA - Databricks Kafka Data Engineer - Senior
Ernst & Young (EY) (company site, opens in a new tab)5–7 yrsBengaluruOn-siteDirect career pageEst. 20–32 LPA
Posted 2d ago
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Ernst & Young (EY)
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Ernst & Young (EY) you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design and implement modern cloud-based Data Lakehouse platforms using Databricks on AWS, including scalable Raw, Silver, and Gold layer architectures.
- Build and optimize large-scale ETL/ELT pipelines and real-time data ingestion frameworks using Kafka, ensuring data quality and operational efficiency.
- Provide technical leadership, collaborate with stakeholders, lead delivery teams, and implement CI/CD pipelines using Azure DevOps and GitHub.
Minimum Requirements
- 5-7 years of experience in data engineering and architecture roles.
- Strong expertise in Databricks, Apache Spark (PySpark/Spark SQL), Kafka Streaming, Delta Lake, and AWS Cloud Services.
- Experience in ETL/ELT design, data modeling (including Fact and Dimension models), and real-time data processing.
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related discipline.
Ideal Candidate Profile
- Experienced in designing enterprise-scale Data Lakehouse solutions with hands-on implementation of multi-layer architectures (Raw, Silver, Gold).
- Proficient in building metadata-driven ingestion and transformation frameworks, and optimizing streaming workloads for performance and resilience.
- Capable of providing technical leadership and mentoring, with experience managing distributed teams and collaborating across stakeholders in a global delivery environment.