Engineer III - Data Engineer
Anaplan (company site, opens in a new tab)6+ yrsGurugramOn-siteDirect career pageEst. 18–30 LPA
Posted 5h ago
Reach people at Anaplan
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Anaplan you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, build, and operate batch and scheduled data pipelines and lead orchestrator upgrades using tools like Airflow, Dagster, and Prefect.
- Develop scalable distributed processing systems using Spark on cloud platforms (AWS EMR, Databricks, GCP) and build analytical query layers with Athena, Snowflake, or BigQuery.
- Own data quality initiatives including validation frameworks, monitoring, and enhance data access APIs in Python for ML and product teams.
Minimum Requirements
- 6+ years of software or data engineering experience, including 3+ years building and maintaining production data pipelines.
- Strong Python development skills with tested and clean code practices (pytest, nox, or tox).
- Experience with workflow orchestration tools (Airflow DAGs, Dagster, Prefect) and cloud data ecosystems (AWS EMR/Athena/S3, Databricks, Snowflake, GCP).
- Proven track record owning production data pipelines with incident response and participation in on-call rotations.
Ideal Candidate Profile
- Experienced with large-scale web data ingestion and scraping infrastructure using tools like Playwright, Selenium, and Scrapy.
- Comfortable managing containerized workloads on Kubernetes with Docker and Helm in production environments.
- Skilled in building multi-cloud data pipelines and integrating data pipelines with machine learning or forecasting systems.