Back
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Tier-1 brand, mid-level Data Engineer in Bangalore with common Azure/Spark skills attracts strong applicant competition.
Core Azure, Spark, and SQL skills are highly transferable across industries.
Explicit 5–7 years requirement plus mandatory Azure, Spark, and CI/CD skills create strict filtering.
Design, develop, and maintain automated data pipelines and ETL processes using Microsoft Azure services including Azure Data Factory, Synapse, Databricks, and Azure storage solutions.
Optimize data pipelines for performance, scalability, and reliability while ensuring data quality and integrity through validation techniques.
Manage CI/CD processes for deploying and maintaining data solutions and collaborate with cross-functional teams to meet data requirements.
Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
5-7 years of professional experience with at least 2 years as a Data Engineer or similar role involving data and ETL processes.
Strong experience with Microsoft Azure data services such as Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage, and Azure Data Lake Storage Gen 2.
Proficient in SQL querying for RDBMS (e.g., SQL Server, PostgreSQL) and knowledge of software engineering principles including CI/CD and version control.
Experienced in designing scalable, modular data pipelines in cloud environments, specifically within Azure ecosystem.
Comfortable managing end-to-end data workflows including data validation, monitoring, and troubleshooting in a global enterprise context.
Familiar with big data technologies like Spark and scripting/programming skills preferably in Python, with abilities relevant to CI/CD and DevOps pipelines.