Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead design and implementation of scalable, secure data architectures and pipelines for member communications using Databricks, Apache Spark, and related technologies.
Own complex data engineering projects end-to-end, managing technical requirements, dependencies, risks, and coordinating across multiple teams.
Improve data quality, observability, governance, and operational excellence while partnering with cross-functional teams to ensure compliance, reliability, and performance.
Minimum Requirements
6+ years of data engineering experience focused on data architecture, pipelines, platforms, and lakehouse management.
Bachelor's or master's degree in Computer Science, Data Science, Engineering or equivalent experience.
Strong proficiency with Python/PySpark, SQL, Databricks, Apache Spark, Delta Lake, CI/CD, and cloud platforms (especially AWS).
Must be located and work remotely from within India; work experience required as stated; no explicit notice period mentioned.
Ideal Candidate Profile
Experienced hands-on data engineer comfortable leading end-to-end delivery and mentoring junior engineers with strong ownership of production outcomes.
Skilled at balancing complex trade-offs involving member privacy, compliance, performance, cost, and data governance in regulated or financial services environments.
Proactive in applying AI tools and automation thoughtfully to improve engineering productivity, data quality, and operational effectiveness.
