Back

Protocol Intelligence

Data-driven signals on your job's competitiveness

CV Match Score

Estimated fit based on your resume

Job Description

Structured overview of role & requirements

Software Engineering Consultant II/Senior Consultant I

Allstate

HybridDirect Career PageEst. 20–30 LPA

Posted 20h ago

Match Score

Against your primary resume

Create a free account or log in to unlock your CV match score across:

Role Fit

Experience

Industry Relevance

get started

Protocol Intelligence

Data-driven signals on your job's competitiveness

Competition Intensity

(Moderate)

Background Fit Sensitivity

(Low)

Shortlisting Strictness

(High)

Job Description

Structured overview of role & requirements

About This Role

Build and maintain scalable data pipelines and ETL/ELT processes using Apache Spark (Scala), Python, Java, and SQL to support large-scale structured and unstructured data.

Design and optimize data models, transformation logic, and integration workflows across MongoDB, relational databases, and data warehouses.

Own data quality, validation, monitoring, CI/CD deployment, and troubleshooting data pipeline issues while collaborating with data scientists, analysts, and business stakeholders.

Minimum Requirements

Proficient in Apache Spark with Scala, Python, Java, SQL, and MongoDB for data engineering tasks.

Experience developing and optimizing ETL/ELT pipelines for large datasets.

Work Experience Required: Not explicitly mentioned in the JD.

Must be familiar with Agile development processes and best practices including TDD and continuous integration.

Ideal Candidate Profile

Experienced in full-stack software product development with strong data engineering focus incorporating Spark and multiple programming languages.

Able to contribute to solution architecture, technical design decisions, and mentoring junior engineers.

Comfortable working in Agile teams and collaborating cross-functionally with data scientists, analysts, and business stakeholders.