Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain complex data pipelines and API products with a focus on Spark and Delta/Data Lake technologies.
Collaborate with engineers and leadership to architect systems and enhance platform capabilities affecting business-critical operations and large-scale analytics.
Support cross-functional teams such as analytics and data science by addressing unique data challenges and needs.
Minimum Requirements
5+ years of Data Engineering experience, including 4+ years designing and building Databricks data pipelines.
4+ years of hands-on experience with Python, PySpark, or SparkSQL; experience with Scala is a plus.
4+ years experience with Big Data pipelines or DAG tools (e.g., Airflow, Dbt, Data Factory).
Work Experience Required: 5+ years (Data Engineering and software development experience combined).
Ideal Candidate Profile
Experienced in cloud-based big data ecosystems, especially Databricks Spark and Delta Lake implementations.
Capable of working autonomously with minimal oversight, contributing to technical growth within the organization.
Skilled in optimizing complex SQL queries and data modeling using Kimball/star schema and medallion architecture methodologies.