Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessMid-level Bangalore data engineer with broad GCP/BigQuery/PySpark requirements increases candidate competition.
Core GCP, BigQuery and PySpark data engineering skills are highly transferable across industries.
Explicit 4-6+ years plus mandatory GCP, BigQuery, PySpark, Terraform and Dataform skills raise shortlisting strictness.
Job Description
Structured overview of role & requirementsAbout This Role
Lead architecture and design of scalable, high-performance ETL/ELT pipelines using GCP services including BigQuery, Cloud Composer, and PySpark on Dataproc.
Optimize BigQuery workloads focusing on partitioning, clustering, materialized views, and slot management to reduce latency and costs.
Drive automation from data ingestion to infrastructure deployment using Terraform and CircleCI; mentor engineers and establish best practices.
Minimum Requirements
4 to 6+ years of hands-on Data Engineering experience (Senior level).
Expertise in GCP services especially BigQuery, Dataform, Cloud Composer, Cloud Storage, Cloud Functions, and Dataproc.
Strong coding skills in Python and SQL with experience writing modular, testable code.
Experience with CI/CD tools and Infrastructure-as-Code (Terraform, CircleCI).
Ideal Candidate Profile
Technical leader with experience architecting complex data pipelines and data warehouse/lakehouse solutions on GCP.
Skilled in query and cost optimization for large-scale data processing environments.
Experience in media or news industry is a strong plus but not mandatory.