Lead Data Engineer - Assistant Vice President
State Street CorporationMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable, production-grade ETL/ELT data pipelines and cloud-native data engineering solutions using Databricks, Python, PySpark, and AWS.
Own optimization of Spark and Databricks workloads for performance, scalability, reliability, and cost efficiency while ensuring data quality and monitoring controls.
Provide technical SME leadership including design and code reviews, troubleshoot complex production issues, and collaborate with cross-functional teams to deliver enterprise-scale data solutions.
Minimum Requirements
10+ years of software or data engineering experience with at least 8+ years in hands-on data engineering and DevOps.
7+ years of experience with Databricks, PySpark/Spark, and cloud-based data engineering on AWS.
Bachelor’s degree in Computer Science, IT, Engineering, Data Science or related discipline.
Role location Bangalore with hybrid working (4 days office); primary working hours 12:00 PM to 9:00 PM India time with flexibility for extended hours including weekends.
Ideal Candidate Profile
Proven track record as a hands-on technical SME in complex enterprise production data environments operating at scale with critical business impact.
Experienced in building high-performance data pipelines and cloud data platforms using Databricks, PySpark, AWS, and SQL with strong troubleshooting and problem-solving capabilities.
Comfortable collaborating across architecture, security, platform, and business teams in regulated or financial services environments supporting continuous improvement and automation.