Associate Technical Architect - Databricks
YASH TechnologiesMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and optimize scalable data pipelines and modern Lakehouse architectures using AWS and Databricks technologies.
Implement data governance including quality, lineage, metadata management, and security within enterprise data solutions.
Develop and deploy GenAI solutions such as RAG-based chatbots and AI agents, ensuring platform scalability, performance, and cost optimization.
Minimum Requirements
10+ years of relevant work experience in data engineering and architecture.
Strong expertise in AWS Data Analytics components (S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB).
Proficient with Databricks technologies including Delta Lake, Iceberg, Unity Catalog, Delta Live Tables, MLflow, and related AI tools.
Advanced programming skills in Python, PySpark, and SQL; experience with ETL/ELT, data modeling, and lakehouse architecture.
Ideal Candidate Profile
Experienced in operating at senior technical levels integrating AWS and Databricks toolsets for enterprise data platforms.
Familiar with advanced GenAI frameworks including RAG, Context Engineering, LLM orchestration, and deploying AI agents in production.
Capable of collaborating with cross-functional teams of data scientists, architects, and business stakeholders to deliver scalable, governed, and cost-effective data solutions.