Data Engineer- Databricks
Annalect (Omnicom Media Group India Private Limited)Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Build and test Databricks data pipelines using PySpark/SQL and Delta Lake for ingestion, transformation, and Gold-layer modeling.
Maintain data quality checks and tests for all pipelines developed, ensuring reliability and accuracy.
Participate actively in agile processes including daily standups, progress reporting, and promptly raising blockers or clarifications.
Minimum Requirements
2–4 years of data engineering experience with hands-on Spark/PySpark and SQL expertise.
Hands-on experience with Databricks platform including Delta Lake, notebooks, and job workflows.
Working understanding of data warehousing/lakehouse concepts such as Bronze/Silver/Gold layered modeling.
Experience working in agile teams with daily standups and sprint-based delivery.
Ideal Candidate Profile
Operates well in an agile environment with strong communication skills to clarify requirements and escalate issues promptly.
Has a proactive approach by applying feedback consistently and seeking to increase ownership over time.
Familiarity or exposure to financial/ERP data sources (e.g., JD Edwards), asset-heavy industries (EPC, construction), and integration middleware (Boomi) is advantageous but not mandatory.