Senior Data Engineer, Bangalore
Sourceo6+ yrsBengaluruOn-siteDirect career pageEst. 15–30 LPA
Posted on 14 Sept
Reach people at Sourceo
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Sourceo you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, develop, and maintain scalable batch and streaming data pipelines on Azure Databricks and Microsoft Fabric using PySpark.
- Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data processing and analytics.
- Manage Microsoft Fabric capacity planning, workspace design, monitoring, security, data sharing, and operational reliability for enterprise-scale data solutions.
Minimum Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 6+ years of proven Data Engineering experience including enterprise cloud data platform delivery.
- Hands-on expertise in PySpark, Azure Databricks, Microsoft Fabric, ETL/ELT processes, and Azure services (Data Lake Storage Gen2, Data Factory, Synapse).
- Advanced SQL skills and experience with data modelling, data warehousing, and CI/CD pipelines using Azure DevOps or Git-based tools.
Ideal Candidate Profile
- Experienced in implementing Medallion Architecture and modern Lakehouse data platforms in enterprise environments.
- Skilled in Microsoft Fabric workspace and capacity management including workload monitoring, optimization, and secure data sharing.
- Ability to lead technical design, conduct code reviews, mentor engineers, and collaborate with cross-functional teams in Agile settings.