Senior Data Engineer
S&P Global (company site, opens in a new tab)6+ yrsHyderabadOn-siteDirect career pageEst. 20–35 LPA
Posted 5d ago
Reach people at S&P Global
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at S&P Global you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Migrate and stabilize data pipelines on a Databricks lakehouse, building reusable batch, streaming and event-driven patterns for reliable, secure production operations.
- Enable standardized, metadata-driven onboarding across datasets and integrate governed pipelines with data mastering workflows, including trusted golden-copy distribution.
- Provide hands-on technical leadership across AWS data engineering, AI-assisted delivery, engineering standards and operational readiness; guide engineers and global teams without direct people management.
Minimum Requirements
- Work Experience Required: 6–8+ years in data engineering, data platforms, cloud data architecture, software engineering or a related engineering domain; senior individual-contributor or equivalent technical leadership experience.
- Hands-on data pipeline experience and Databricks platform experience, including migration or transition to a lakehouse architecture; familiarity with AWS data engineering services including S3, Glue, Lambda, Lake Formation, Kinesis and IAM.
- Practical engineering use of AI tools such as Claude, GitHub Copilot or similar, including prompt/context engineering and validating outputs for production use; understanding of enterprise security, privacy and compliance safeguards.
- Experience with production data pipeline quality, governance and operations, including data quality, access controls, monitoring, testing and CI/CD; exposure to mastering, MDM, reference data or trusted data distribution workflows.
Ideal Candidate Profile
- A senior hands-on engineer who can turn platform architecture into migration plans, reusable implementation patterns and production-ready pipelines, while influencing delivery without formal authority.
- Best aligned to complex, governed enterprise data environments, ideally with financial or investment data and experience integrating mastering or golden-record workflows; NeoXam DataHub is a plus.
- Comfortable working across Databricks and AWS and applying AI-assisted engineering to code, tests, troubleshooting and documentation, with careful human review before production use.