Senior Databricks Engineer, Apache Spark and AWS - Vice President
CitiMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead modernization and refactoring of legacy Hadoop pipelines to Databricks native architectures on AWS, enhancing scalability and performance.
Design and optimize Spark (JavaSpark/PySpark) applications using Databricks features such as Delta Lake, Autoscaling, and job orchestration workflows.
Contribute to architectural decisions, develop reusable components, and ensure solutions are scalable, maintainable, and production-ready with strong performance optimization.
Minimum Requirements
10+ years of experience in data engineering or distributed systems.
Strong expertise with Apache Spark (JavaSpark/PySpark), Databricks on AWS, Delta Lake, and SQL.
Experience modernizing legacy data platforms to cloud-based AWS architectures and Spark performance tuning.
Bachelor's degree or equivalent experience.
Ideal Candidate Profile
Proven ability to translate high-level architecture into detailed technical designs and data pipeline models for complex systems.
Experienced in simplifying and optimizing large-scale batch processes in production environments.
Comfortable working collaboratively with architects, platform teams, and stakeholders in high-impact, time-bound projects.