Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable data engineering solutions and pipelines using Azure Databricks, Azure Data Lake Storage Gen2, PySpark, and SQL.
Optimize data lake architectures, batch and incremental data processing pipelines, and implement robust data quality and reconciliation frameworks.
Collaborate with cross-functional teams to ensure secure, high-quality, and cost-optimized production data platforms with monitoring and support responsibilities.
Minimum Requirements
6+ years of work experience in Data Engineering.
Strong hands-on expertise with Azure Databricks, PySpark, SQL, Azure Data Lake Storage Gen2, Delta Lake, and Azure Data Factory.
Bachelor's or Master's degree in Computer Science, IT, Engineering, Data Science, or related discipline.
Location requirement: Hyderabad, Telangana, India (implied onsite).
Ideal Candidate Profile
Demonstrated experience building large-scale, production-critical ETL/ELT pipelines on Microsoft Azure cloud with batch and near-real-time ingestion.
Proven ability to optimize Spark workloads, data partitions, and cloud infrastructure costs while maintaining high availability and data governance compliance.
Experience working closely with distributed engineering teams and stakeholders across data engineering, architecture, BI, DevOps, and governance to deliver secure and scalable data solutions.