Senior Data Engineer
Commonwealth Bank of Australia (company site, opens in a new tab)8–12 yrsBengaluruOn-siteDirect career pageEst. 30–48 LPA
Posted on 11 Sept
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Commonwealth Bank of Australia
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Commonwealth Bank of Australia you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Lead the setup and management of the Group Security Data Platform for ingesting and processing security telemetry data and other data assets.
- Design, build, and maintain scalable data pipelines (batch and real-time) to support AI/ML models and security use cases integrating with enterprise platforms like ServiceNow SecOps.
- Own end-to-end data engineering lifecycle including requirement gathering, data modelling, development, deployment, and DevSecOps processes with responsibility for technical strategy and roadmaps.
Minimum Requirements
- 8-12 years of experience as a Data Engineer in data-intensive environments.
- Proficiency in AWS services including EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DynamoDB, IAM, Step functions, among others.
- Strong Python skills with experience in developing complex frameworks and mandatory knowledge of PySpark/Spark and associated performance optimizations.
- Bachelor's or Master's degree in Engineering, Computer Science, Information Technology or related field.
Ideal Candidate Profile
- Experienced in leading medium to complex engineering initiatives with strategic ownership of technical assets and roadmaps.
- Strong expertise in cloud-based data engineering with hands-on skills in DevOps tools like Terraform, Jenkins, Docker, Kubernetes integrated into data pipeline automation.
- Capable of working independently and collaboratively within cyber security and AI/ML focused teams to innovate with automation, data security best practices including encryption methods, and scalable data solutions.