Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, build, and maintain data ingestion pipelines into Databricks from multiple sources using PySpark and PySQL.
Develop, test, and refine AI-driven applications integrating Databricks Apps, Claude Models, and Chat UI interfaces.
Implement and manage Databricks Unity Catalog permissions, deploy custom notifications, and enforce AI safety guardrails including retrieval augmented generation and prompt engineering.
Minimum Requirements
Proficiency in PySpark and PySQL for data pipeline development.
Experience with Databricks Unity Catalog permissions model, OBO tokens, and service principal configuration.
Familiarity with building and deploying Databricks Apps using Visual Studio Code.
Work Experience Required: Not explicitly mentioned in the JD
Ideal Candidate Profile
Experienced in integrating AI models such as Claude APIs with Databricks environments.
Strong skills in prompt engineering, token economics understanding, and rule enforcement within AI applications.
Able to combine backend AI deployment (FastAPI) with frontend SPA development (React) focused on Chat UI and user prompt interactions.