Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable ETL/ELT data pipelines on the Databricks Lakehouse using PySpark, SQL, and Python.
Integrate and process data from multiple sources including databases, Amazon S3, and REST APIs, implementing business logic and data transformations.
Manage and optimize Databricks Jobs, Delta Lake tables following Medallion Architecture, ensuring data quality, performance, and scalability.
Minimum Requirements
4+ years of experience in Data Engineering with at least 2 years hands-on experience on Databricks.
Strong expertise in Python, PySpark, Advanced SQL, and ETL/ELT development.
Experience with Databricks Lakehouse Platform components including Unity Catalog, Delta Lake, Workflows/Jobs, and Medallion Architecture.
Experience integrating with REST APIs and working knowledge of data warehousing concepts and data modeling (Star/Snowflake schemas, SCD).
Ideal Candidate Profile
Experienced in building production-ready data pipelines in cloud environments, specifically leveraging Databricks and AWS.
Capable of optimizing Spark workloads for performance and reliability and managing complex data transformation and modeling.
Familiarity with version control and CI/CD processes, with possible additional skills in Kafka, Airflow, dbt, or Databricks certification seen as advantages.