Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessKnown brand, metro location, mid-level generalist data role with broad GCP skillset.
Core data engineering skills (BigQuery, PySpark, Airflow) are highly transferable across industries.
Multiple mandatory GCP, BigQuery, PySpark, IaC and years requirements increase shortlisting rigidity.
Job Description
Structured overview of role & requirementsAbout This Role
Lead design and architecture of scalable, high-performance ETL/ELT data pipelines within GCP using Cloud Composer and PySpark on Dataproc.
Optimize BigQuery performance and costs through techniques like Partitioning, Clustering, Materialized Views, and slot management.
Implement and manage BigLake architecture for unified governance of data lakes and warehouses, and drive automation of data ingestion and infrastructure deployment via Terraform and CircleCI.
Minimum Requirements
4-6+ years of hands-on Data Engineering experience, Senior level.
Expertise in GCP services including BigQuery, DataForm, Cloud Composer, Cloud Storage, Cloud Functions, and Dataproc.
Strong Python and SQL programming skills; experience with Data Modeling concepts (Star Schema, Snowflake).
Experienced with CI/CD tools and Infrastructure-as-Code (Terraform).
Ideal Candidate Profile
Proven technical leadership in data architecture and pipeline optimization within GCP environments.
Experience mentoring mid-level engineers and setting best practices for code and architecture.
Prior exposure to News or Media industry is a plus but not mandatory.