Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, build, and maintain scalable batch and streaming data pipelines using Apache Spark and cloud-native platforms.
Develop and optimize ETL/ELT workflows to create analytics-ready datasets supporting reporting, dashboards, and ML workloads.
Ensure data quality, performance, scalability, and operational excellence across data platforms including Microsoft Fabric / One Lake.
Minimum Requirements
Proven experience as a Data Engineer building and operating production data pipelines, preferably 4+ years.
Hands-on proficiency with Apache Spark, Python, SQL, and cloud-based data platforms (e.g., Data Lakes, Lakehouse).
Experience designing and optimizing data models and implementing CI/CD pipelines for data workloads.
Familiarity with Microsoft Fabric or One Lake is a strong plus; Work Experience Required: Not explicitly mentioned in the JD.
Ideal Candidate Profile
Experienced in large-scale distributed data processing and performance tuning in cloud environments.
Skilled in creating reusable frameworks and collaborating across technical and non-technical teams for data solutions.
Comfortable with Agile methodologies and partnering with analytics, BI, and data science teams to deliver data products.