Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Build and operate data pipelines feeding the Entity Hub from six in-scope sources into Fabric.
Implement data standardization, transformation logic, and maintain data quality checks plus monitoring essential for entity resolution.
Lead data validation, user acceptance testing (UAT), regression tests, and document data integration and models including schema design and optimization.
Minimum Requirements
5-7 years of experience as a Data Engineer.
Proficient in Python, Pyspark, SQL and experienced with Hadoop, Hive, Azure (Data Factory, Databricks), Databricks, and Greenplum.
Degree in Data Science, Statistics, Computer Science, or related field, or equivalent experience.
Experience working with stakeholders on data requirements, data testing, and ability to automate data validation and quality processes.
Ideal Candidate Profile
Experienced handling complex ETL processes and big data technologies in a cloud environment (Azure).
Demonstrates strong problem-solving and troubleshooting skills focused on ensuring reliable and observable data ingestion.
Capable of leading cross-functional collaboration with business teams on data testing and validation activities.