Associate Technical Architect - Databricks
YASH Technologies (company site, opens in a new tab)10+ yrsPuneOn-siteDirect career pageEst. 25–40 LPA
Posted on 26 Sept
Reach people at YASH Technologies
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at YASH Technologies you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, develop, and optimize scalable data pipelines and modern Lakehouse architectures using AWS and Databricks technologies.
- Implement data governance including quality, lineage, metadata management, and security within enterprise data solutions.
- Develop and deploy GenAI solutions such as RAG-based chatbots and AI agents, ensuring platform scalability, performance, and cost optimization.
Minimum Requirements
- 10+ years of relevant work experience in data engineering and architecture.
- Strong expertise in AWS Data Analytics components (S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB).
- Proficient with Databricks technologies including Delta Lake, Iceberg, Unity Catalog, Delta Live Tables, MLflow, and related AI tools.
- Advanced programming skills in Python, PySpark, and SQL; experience with ETL/ELT, data modeling, and lakehouse architecture.
Ideal Candidate Profile
- Experienced in operating at senior technical levels integrating AWS and Databricks toolsets for enterprise data platforms.
- Familiar with advanced GenAI frameworks including RAG, Context Engineering, LLM orchestration, and deploying AI agents in production.
- Capable of collaborating with cross-functional teams of data scientists, architects, and business stakeholders to deliver scalable, governed, and cost-effective data solutions.