Back
Remote metro role with moderate demand for Databricks specialists yields medium competition.
Role's Azure Databricks and Delta Lake specialization limits portability across non-Azure environments.
Mandatory 6+ years plus specific Databricks, Spark, Azure, Delta Lake and ADF skills increase shortlisting strictness.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Design, develop, and maintain scalable data pipelines and analytics solutions using Azure Databricks and associated tools.
Optimize Spark jobs and manage Delta Lake tables for performance, cost, scalability, and advanced features (ACID, time travel, schema evolution).
Collaborate with data scientists and stakeholders to support analytics and ML use cases ensuring data quality, security, and governance.
6+ years of experience in Data Engineering.
Strong hands-on expertise with Azure Databricks, Python (PySpark), SQL, and Apache Spark.
Experience with Delta Lake and Azure Data Lake Storage (ADLS Gen2).
Work Experience Required: 6+ years as specified in the JD.
Experienced in building and optimizing data pipelines on Azure cloud with strong distributed computing knowledge.
Ability to implement and maintain ETL/ELT workflows using Spark SQL and Python for large and diverse datasets.
Familiarity with Azure data ecosystem tools (Azure Data Factory, Azure DevOps) and best practices for data security and governance.