Senior Data Engineer- Databricks
Annalect (Omnicom Media Group India Private Limited)Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Own substantial components of the Databricks platform including end-to-end pipelines from ingestion through Gold-layer modeling for financial and operational data.
Manage and deliver a defined workstream from intake to delivery, including testing, documentation, and implementing security controls (row-level and column-level) on data sets.
Proactively identify and raise technical debt, data quality issues, provide code reviews and feedback to less experienced engineers, and support integration build/validation using Boomi.
Minimum Requirements
5+ years of data engineering experience with at least 2–3 years hands-on Databricks experience (Spark/PySpark, Delta Lake, Unity Catalog).
Experience building data pipelines from financial or ERP source systems, preferably JD Edwards (JDE).
Strong SQL and Python skills with end-to-end pipeline ownership capability.
Experience working in agile sprint environments with daily standups.
Ideal Candidate Profile
Experienced in pipeline design and delivery within financial or ERP domains, particularly with JD Edwards or similar.
Comfortable working independently with minimal supervision, able to resolve ambiguity efficiently and take end-to-end ownership.
Familiar with security implementations in Unity Catalog and integration platforms (Boomi or similar) in hybrid onshore/offshore delivery models.