Lead/ Sr AI Databricks Engineer
Enable Data (company site, opens in a new tab)BengaluruHybridDirect career pageEst. 20–35 LPA
Posted on 9 Sept
Reach people at Enable Data
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Enable Data you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design and build data pipelines into Databricks using PySpark and PySQL from multiple data sources like SAP and web scraping.
- Develop and deploy Databricks Apps, configure Azure and Databricks resources including authentication models, permissions, and CI/CD deployment pipelines.
- Apply AI capabilities including FastAPI/React front-ends, prompt engineering, Retrieval Augmented Generation on Databricks, and implement AI safety guard rails.
Minimum Requirements
- Proficient in PySpark, PySQL, Databricks Unity Catalog permissions, and Databricks Apps development.
- Experience with Azure resource configuration for Databricks deployments and CI/CD pipeline automation including security validations.
- Familiarity with AI toolsets such as Claude Models/APIs, prompt engineering, and Retrieval Augmented Generation methods.
- Work Experience Required: Not explicitly mentioned in the JD. Notice Period: Only immediate joiners preferred.
Ideal Candidate Profile
- Experienced in integrating data pipelines and managing Databricks environments with a focus on security, permissions, and deployment automation.
- Skilled in AI application development layered on Databricks platforms, including usage of language models and prompt engineering for domain-specific solutions.
- Comfortable working individual contributor in agile sprint cycles collaborating with technical and non-technical stakeholders on minimal requirements.