Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable batch and streaming data pipelines on Azure Databricks and Microsoft Fabric using PySpark.
Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data processing and analytics.
Manage Microsoft Fabric capacity planning, workspace design, monitoring, security, data sharing, and operational reliability for enterprise-scale data solutions.
Minimum Requirements
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
6+ years of proven Data Engineering experience including enterprise cloud data platform delivery.
Hands-on expertise in PySpark, Azure Databricks, Microsoft Fabric, ETL/ELT processes, and Azure services (Data Lake Storage Gen2, Data Factory, Synapse).
Advanced SQL skills and experience with data modelling, data warehousing, and CI/CD pipelines using Azure DevOps or Git-based tools.
Ideal Candidate Profile
Experienced in implementing Medallion Architecture and modern Lakehouse data platforms in enterprise environments.
Skilled in Microsoft Fabric workspace and capacity management including workload monitoring, optimization, and secure data sharing.
Ability to lead technical design, conduct code reviews, mentor engineers, and collaborate with cross-functional teams in Agile settings.