Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Develop, deploy, and maintain scalable data processing pipelines using Azure Databricks, Apache Spark, and Python (PySpark) handling TB-scale datasets.
Design and implement modern data lake architectures, ETL frameworks, and ensure data quality and reliability.
Collaborate with architects, analysts, and stakeholders to implement data solutions, optimize performance, and support continuous improvement initiatives.
Minimum Requirements
5+ years of hands-on experience with Azure Databricks, Apache Spark, Python (PySpark), and SQL development.
Experience processing and optimizing terabyte-scale datasets with strong ETL and data lake architecture knowledge.
Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.
Location requirement: Hybrid role based in Pune, India with up to 3 days per week onsite.
Ideal Candidate Profile
Experienced in enterprise-scale Azure data engineering projects using Azure Databricks and Spark in cloud environments.
Proficient in performance tuning, troubleshooting, and optimizing large-scale data processing workflows.
Comfortable working collaboratively with cross-functional teams to translate business requirements into technical data solutions.