Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable batch and streaming data pipelines using Apache Spark and Microsoft Fabric technologies.
Provide technical leadership and mentorship to junior engineers while driving engineering best practices in CI/CD, code quality, and automation.
Collaborate with cross-functional teams to deliver trusted, reusable, analytics-ready datasets and support enterprise-scale data solutions including lakehouse and data warehouse architectures.
Minimum Requirements
Strong expertise with Apache Spark (PySpark/Spark SQL) and Microsoft Fabric, OneLake, Lakehouse, Data Warehouse, and Semantic Models.
Proven experience building and optimizing ETL/ELT pipelines and working knowledge of streaming and batch data processing.
2 or more years of experience preferred; Bachelor’s degree preferred (or equivalent combination of education and experience).
Work Experience Required: 2 or more years of experience preferred
Ideal Candidate Profile
Experienced individual contributor comfortable leading technical design and implementation of enterprise data engineering solutions without direct people management.
Skilled in cloud-based data platforms and modern data engineering practices, with ability to balance engineering excellence and productivity.
Able to collaborate effectively with Analytics Engineers, Data Scientists, Product Managers, and Security teams to deliver data products aligned to business needs.