Senior AI Data Engineer
Luxoft (a DXC Technology Company) (company site, opens in a new tab)5+ yrsBengaluruOn-siteDirect career pageEst. 20–40 LPA
Posted on 31 Aug
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Luxoft (a DXC Technology Company)
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Luxoft (a DXC Technology Company) you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, develop, and maintain AI data engineering pipelines, focusing on full-stack Python applications integrating frontend frameworks with backend AI services.
- Build and optimize Retrieval-Augmented Generation (RAG) systems and implement vector databases to support AI applications relevant to Trading Surveillance.
- Develop, maintain, and monitor data pipelines, ETL/ELT workflows, and CI/CD pipelines ensuring performance and reliability for AI/ML workloads.
Minimum Requirements
- Minimum 5 years of experience in AI/ML solution implementation (mandatory).
- Minimum 3 years of hands-on experience with Pyspark processing high volume data (mandatory).
- Strong knowledge of Pyspark internals such as lazy evaluation, window functions, spark architecture, and performance tuning techniques like data skew reduction and join optimizations.
- English language proficiency at C2 level (Proficient).
Ideal Candidate Profile
- Experience in building Agentic AI systems and pipelines, particularly for code conversion from Q KDB to Pyspark is highly relevant.
- Demonstrated ability to design and implement full-stack AI solutions, integrating frontend to backend with AI components.
- Strong expertise in advanced AI/ML topics including Multi-Agent System Design, Full-stack AI Integration, Advanced Prompt Engineering, and LLM Observability and Monitoring (LLMOps).