Python and Apache Spark Big Data Engineer - Assistant Vice President
Citi (company site, opens in a new tab)8–12 yrsPuneHybridDirect career pageEst. 28–45 LPA
Posted 12h ago
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Citi
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Citi you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Design, build, and maintain efficient, reusable, and reliable Python/Scala code for Big Data applications using Spark and related technologies.
- Ensure high performance, quality, and responsiveness of Big Data applications by identifying and resolving bottlenecks and bugs.
- Develop high performance and low latency components to run Spark clusters and process large datasets using Hive, Impala, and HBASE.
Minimum Requirements
- 8 to 12 years of relevant work experience in Big Data and programming.
- Strong programming skills in Python and/or Apache Spark.
- Experience with Big Data technologies including HDFS, MapReduce, YARN, Apache Spark, Hive, and data formats like Avro, Parquet, CSV, JSON.
- Familiarity with UNIX/Linux environments and shell scripting; solid understanding of database principles and SQL.
Ideal Candidate Profile
- Experienced in application performance tuning and troubleshooting specifically in the Big Data domain.
- Ability to translate functional requirements into scalable Big Data platform solutions and propose best practices and standards.
- Comfortable collaborating with global teams across different locations and working with Agile/Scrum methodologies, SCM tools like Git, and continuous integration tools.