Sr. Data Engineer-Hadoop,Hive,Spark,Trino, Star Rocks, Clickhouse
Visa (company site, opens in a new tab)5+ yrsBengaluruOn-siteDirect career pageEst. 25–40 LPA
Posted 12h ago
Reach people at Visa
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Visa you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Collaborate with stakeholders to gather and clarify data requirements supporting business and product features.
- Translate functional requirements into scalable architecture designs and own end-to-end delivery of data products/pipelines, ensuring quality, security, and maintainability.
- Develop, test, deploy, and monitor complex data pipelines using technologies like Hadoop, Hive, Spark, and Trino, including automations and troubleshooting production issues.
Minimum Requirements
- 3+ years relevant experience with a Bachelor's degree OR 5+ years relevant experience without specifying degree.
- Hands-on experience with Hadoop, Hive, HBase, Spark, Trino or comparable distributed data systems.
- Proficiency in data pipeline design, ETL/ELT, SQL, Java or Python, production troubleshooting, and code quality practices.
- Visa requires 3 days per week in-office attendance; specific days to be confirmed by hiring manager.
Ideal Candidate Profile
- Experienced in building enterprise-class, scalable, real-time data systems with strong architecture knowledge across storage, compute, streaming, and governance.
- Skilled in automation, CI/CD pipeline development, containerization, observability tools, and integrating AI/ML services into data platforms.
- Capable of working independently to translate business needs into secure, maintainable, and documented technical solutions aligned with regulatory standards.