Data Engineer
ScaleupAlly (company site, opens in a new tab)5–8 yrsNoidaOn-siteDirect career pageEst. 15–28 LPA
Posted 18h ago
Reach people at ScaleupAlly
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at ScaleupAlly you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Own end-to-end design and delivery of data pipelines and production data platforms, including architecture, build, testing, deployment, and support.
- Design data models aligned with business usage and build scalable ETL/ELT pipelines using Python, SQL, PySpark, and Azure tools.
- Implement batch, incremental/CDC, and streaming data loads; optimize Spark and SQL performance and costs; ensure data quality and governance; automate CI/CD processes; and collaborate with client stakeholders for requirements gathering and acceptance.
Minimum Requirements
- Bachelor's degree in Information Systems, related field, or any discipline.
- 5-8 years of data engineering work experience.
- Proficiency in SQL, Python, PySpark, Git, CI/CD, and experience with Azure Databricks or Microsoft Fabric and Azure Data Factory or equivalent.
- Experience delivering batch and incremental/CDC pipelines on Delta Lake or similar platforms.
Ideal Candidate Profile
- Strong dual expertise in data modeling (dimensional, Medallion/Lakehouse) and data engineering (performance tuning, automated testing).
- Experience working directly with clients, gathering requirements, and documenting technical solutions.
- Hands-on with cloud data platforms (Azure Databricks/Microsoft Fabric), and able to improve runtime, cost, or data quality with measurable impact.