Data Engineer II (Data Warehouse, Big Data, Spark with Scala/Python/Java on Hadoop, Oracle/SQL)
Mastercard (company site, opens in a new tab)3–5 yrsPuneOn-siteDirect career pageEst. 14–24 LPA
Posted 13h ago
Reach people at Mastercard
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Mastercard you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Develop and maintain high quality, secure, and scalable data pipelines using Spark with Scala/Python/Java on Hadoop or object storage.
- Innovate and drive automation to enhance data ingestion, movement, and access workflows in large-scale Big Data environments.
- Contribute to enforcing and improving data engineering standards and support production incident resolution.
Minimum Requirements
- 3-5 years of experience in Data Warehouse-related projects within product or service-based organizations.
- Proven expertise in Data Engineering with multiple end-to-end Data Warehouse implementations in Big Data environments.
- Experience building data pipelines using Spark with Scala/Python/Java on Hadoop or Object Storage.
- Strong SQL skills with experience in databases like Oracle and Netezza; experience with Nifi is a plus but not mandatory.
Ideal Candidate Profile
- Experienced in managing large-scale Big Data environments with practical implementation of Spark and Hadoop ecosystem technologies.
- Skilled in debugging production issues and implementing root cause analysis and mitigation plans independently.
- Capable of working in geographically distributed matrix teams and driving results with a high degree of initiative in a fast-paced environment.