Data Engineer II

Design, build, test, troubleshoot, and optimize end-to-end data engineering solutions including data modeling, ingestion, transformation, orchestration, and production support in a cloud-based environment.

Develop scalable, secure, observable, and fault-tolerant data workflows using SQL, Python, PySpark, Snowflake, dbt, Airflow, Spark, and AWS services with adherence to medallion architecture and enterprise standards.

Implement automated data quality controls, governance practices, and collaborate across teams to produce reusable enterprise data products, source-to-enterprise mappings, and validated reports.

Bachelor's degree in computer science, engineering, information systems, or relevant field, or equivalent practical experience.

Hands-on experience in advanced SQL, Python, and PySpark or Spark for distributed data processing.

Experience designing and operating ETL/ELT pipelines, dimensional data models, and production-grade data workflows using Snowflake, dbt, Airflow, and AWS services.

Work Experience Required: Not explicitly mentioned in the JD. Primary work location is Trivandrum with a hybrid work model.

Experience working on cloud-based data platforms with enterprise-scale data engineering and analytics responsibilities aligned to medallion architecture and star-schema standards.

Proficient in building fault-tolerant, scalable data workflows with practical knowledge of CI/CD, version control, automated testing, and Agile delivery methodologies.

Comfortable collaborating with cross-functional remote teams and translating business requirements into maintainable technical designs in regulated or secure environments.