Consultant/Senior Consultant | Databricks |Coimbatore | Engineering | Data Modernization & Migration
DeloitteMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable enterprise data engineering solutions using Databricks and Lakehouse architecture.
Build and optimize batch and real-time data processing pipelines leveraging PySpark, Spark SQL, and Delta Lake for large-scale data workloads.
Collaborate with cross-functional teams to implement data governance, security, monitoring, and support production deployment and operational excellence.
Minimum Requirements
6-9 years of IT experience with minimum 4 years of hands-on Databricks and Spark development.
Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or related field.
Proficient in Databricks Lakehouse Platform including Delta Lake, PySpark, Spark SQL, and performance tuning of Spark jobs.
Experience with cloud platforms (Azure, AWS, or GCP) and large-scale data pipeline development.
Ideal Candidate Profile
Experienced in building enterprise-scale data engineering solutions using cloud-native analytics platforms, preferably Azure.
Strong expertise in distributed data processing and Lakehouse architecture, including implementing Delta Lake and Unity Catalog.
Demonstrated ability to optimize Spark workloads and design reusable data frameworks with involvement in Agile environments.