Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessRemote posting and common 'Data Engineer' title increase applicants, but Azure specialization reduces volume.
Azure Databricks and Delta Lake specialization makes cross-industry moves moderately challenging.
Explicit 10+ years requirement plus mandatory Azure Databricks, PySpark, and Delta Lake skills make filters strict.
Job Description
Structured overview of role & requirementsAbout This Role
Build and maintain scalable enterprise data pipelines using Azure Databricks and Azure Data Factory focusing on Bronze, Silver, and curated data layers.
Optimize Delta Lake tables and Spark jobs for performance and cost efficiency while ensuring data quality and reliability.
Collaborate with DWH and reporting teams to provide optimized datasets for downstream reporting and analytical workloads.
Minimum Requirements
10+ years of work experience in data engineering or related roles.
Strong hands-on experience with Azure Databricks, Azure Data Factory, PySpark, SQL, and Delta Lake.
Proven skills in data pipeline development including batch and incremental processing, data transformation, and performance tuning of Spark and Delta Lake.
Work Experience Required: 10+ years
Ideal Candidate Profile
Experienced senior-level data engineer capable of independently designing and developing complex pipelines in enterprise Azure environments.
Skilled in performance, scalability, reliability, and ensuring data quality across pipeline components integrated with downstream DWH and reporting systems.
Strong ownership with ability to troubleshoot production data issues and implement best practices including CI/CD and Agile process adherence.