Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)
TietoMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessNiche senior data-engineering skills with metro location produce moderate applicant competition.
Core PySpark, Airflow and AWS data engineering skills are highly transferable across industries.
Explicit 10+ years and mandatory PySpark/Cloudera/Iceberg/Airflow/AWS requirements enforce high strictness.
Job Description
Structured overview of role & requirementsAbout This Role
Develop and maintain PySpark-based data pipelines on Cloudera Data Platform.
Design and manage workflows using Apache Airflow for ETL/ELT processes involving large-scale structured and unstructured datasets.
Leverage Apache Iceberg architecture and AWS services to build and optimize cloud-native data lake and Lakehouse solutions.
Minimum Requirements
Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
10+ years of IT experience including 6+ years in Data Engineering and Big Data development.
Strong hands-on experience with PySpark, Cloudera Data Platform, Apache Iceberg, Apache Airflow, and SQL/data modeling.
Experience with AWS services such as S3, Glue, Lambda, ECS/EKS, EMR; knowledge of data partitioning, performance tuning, and query optimization.
Ideal Candidate Profile
Senior developer with 10-12+ years of experience, including leadership or lead developer roles in large-scale data engineering projects.
Experienced in designing and implementing ETL/ELT pipelines using PySpark and managing complex workflows via Airflow in cloud environments.
Background in cloud migration or modernization projects, preferably with certifications in AWS or Cloudera and domain knowledge in healthcare or insurance sectors.