Back
Niche Databricks/PySpark specialization and smaller employer reduce applicant density despite metro location.
Databricks and PySpark expertise required, limiting cross-industry transferability.
Explicit 4-6 years plus mandatory Databricks, PySpark, SQL, Python and ETL skills.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Own building and management of data engineering solutions using Databricks.
Develop, optimize, and support ETL/ELT pipelines for batch and near real-time data workloads.
Troubleshoot and monitor production data pipelines ensuring reliability and performance.
4 to 6 years of relevant experience.
Strong hands-on experience with Databricks and PySpark for large-scale data processing.
Advanced SQL skills including complex queries and performance tuning.
Proficiency in Python for data processing and automation.
Experience optimizing and automating data pipelines in production environments.
Familiarity with tools like dbt, Apache Airflow, and CI/CD pipelines indicating end-to-end data engineering capability.
Knowledge of data warehousing concepts and data governance best practices to ensure robust data solutions.