Lead Software Engineer - Data Engineer + Python + Spark/Pyspark+ AWS
JPMorgan Chase & Co.Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead design, delivery, and operation of reliable, scalable batch and streaming data platforms and pipelines powering critical business use cases.
Own data modeling, curation, and ETL/ELT workflows with strong validation, SLAs/SLOs, lineage, and compliance controls.
Set engineering standards and lead adoption of AI-assisted development tools while partnering across teams for governance and operational stability.
Minimum Requirements
5+ years of applied software engineering experience with formal training or certification.
Hands-on proficiency in Java and Python for production-grade data platforms, including strong SQL and data modeling skills.
Experience with pipeline orchestration tools (e.g., Airflow), transformation frameworks (e.g., dbt), and maintenance of secure, scalable data processing solutions.
Experience building and operating search/indexing workflows (e.g., Elasticsearch) and production support ownership in a regulated environment.
Ideal Candidate Profile
Experienced lead Data Engineer skilled in end-to-end building and operation of curated datasets and production data pipelines in enterprise settings.
Proficient in secure engineering practices, cross-functional collaboration, and advancing team usage of AI-assisted development workflows.
Familiar with cloud-native environments (AWS), large-scale distributed processing (Spark), event streaming architectures, and regulated risk and control frameworks.