Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable production-grade data pipelines using Azure Databricks, Python, and SQL.
Integrate Large Language Model (LLM) and Generative AI capabilities into data engineering solutions to support AI-powered applications.
Monitor, troubleshoot, and optimize data pipelines handling large-scale structured and semi-structured datasets, ensuring data quality and reliability.
Minimum Requirements
Strong hands-on experience with Azure Databricks, Python programming, and advanced SQL query development.
Experience developing production-grade ETL/ELT data pipelines and working with large-scale structured/semi-structured data.
Solid understanding of data modeling, data warehousing, and cloud data architectures.
Work Experience Required: Not explicitly mentioned in the JD
Ideal Candidate Profile
Experienced in integrating LLM APIs and Generative AI into enterprise data solutions, with knowledge of prompt engineering and RAG fundamentals.
Skilled in troubleshooting and optimizing production data pipelines within cloud environments (especially Azure).
Familiar with best practices in CI/CD, data governance, security, and collaboration with cross-functional teams in a technologically advanced setup.