Back
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Strong brand, mid-level data role in Bengaluru with broad Databricks/Spark/Python requirements.
Core Databricks/Spark data engineering skills transfer across industries, though gaming/marketing knowledge adds specificity.
Multiple mandatory skills (Databricks, PySpark, SQL, CI/CD) and 5+ years requirement.
Lead design and implementation of scalable, stable data pipelines using stream and batch processing architectures.
Drive improvements in data architecture, quality, monitoring, and availability, integrating new data sources for reliability.
Develop and oversee data quality frameworks, enterprise-wide data dictionary, and monitoring/alerting policies for critical data systems.
5+ years experience with SQL, Python (including PySpark on Databricks), and large-scale distributed computing technologies (Spark/Hive/Hadoop).
Demonstrated experience with Databricks platform optimization and pipeline orchestration.
Experience with CI/CD systems and testing/monitoring data for anomalies and issue resolution.
Work Experience Required: 5+ years; Location and notice period: Not explicitly mentioned in the JD.
Experienced in leading architecture and implementation of end-to-end big data systems in a global, cross-functional environment.
Strong background in distributed computing and data platform optimization, particularly with Databricks and related ecosystems.
Capable of enforcing best practices in coding, source management, and mentoring junior engineers, with knowledge of agile software development lifecycle.