Principal Member Technical Staff - Data engineer
Nielsen (company site, opens in a new tab)10–15 yrsBengaluruOn-siteDirect career pageEst. 30–50 LPA
Posted 3h ago
Reach people at Nielsen
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Nielsen you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Lead the design and delivery of batch and near-daily data pipelines from raw inputs through curated outputs to a Master Data Layer.
- Drive multiple complex, cross-functional projects end-to-end with accountability for measurable business outcomes and technical direction without people management.
- Develop, operate, and optimize data-processing workflows including real-time and streaming event handling, applying an AI-first approach to improve data quality and operational efficiency.
Minimum Requirements
- Typically 10–15 years of data engineering or equivalent experience with complex production data systems.
- Bachelor’s degree in Computer Science, Engineering, Information Systems or related field, or equivalent practical experience.
- Expert-level SQL and strong programming skills in Python and/or Scala/Java; hands-on experience with Apache Spark or similar distributed data-processing frameworks.
- Proven experience with AWS or comparable cloud platform services for data pipelines including object storage (S3), columnar formats (Parquet), orchestration tools (Airflow), metadata/catalog services, and query engines (Athena).
Ideal Candidate Profile
- Experienced in building and supporting production data pipelines with deep understanding of data semantics, schema evolution, source-to-target lineage, and event-driven processing patterns.
- Demonstrates ability to autonomously lead multiple projects with technical influence and ownership of business outcomes across cross-functional teams without formal management authority.
- Possesses expertise in AI-assisted data processing techniques and a practical mindset for integrating AI/ML to enhance data exploration, processing quality, and operational workflows while ensuring validation and security.