Data Engineer
Talentbrew (company site, opens in a new tab)PuneOn-siteDirect career pageEst. 25–45 LPA
Posted 21d ago
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Talentbrew
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Talentbrew you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Ensure availability, performance, and scalability of data engineering systems through proactive monitoring, capacity planning and incident resolution.
- Lead design, development, and optimization of enterprise-scale data platforms and data products using Databricks, Snowflake, Spark, and cloud technologies.
- Drive platform modernization initiatives, build scalable data pipelines, and lead a team of data engineers to deliver business-critical data solutions.
Minimum Requirements
- Strong expertise in Databricks Lakehouse Platform, Apache Spark (PySpark, Spark SQL), and Python programming.
- Experience with Delta Lake, Unity Catalog, Databricks Workflows, SQL tuning, Linux scripting, orchestration tools (TWS, Airflow), and AWS services (Glue, Lambda, S3, Lake Formation, Athena).
- Experience in ETL/ELT frameworks, CDC, data quality, governance, metadata management, lineage, and catalog solutions.
- Work Experience Required: Not explicitly mentioned in the JD; Location: Pune, India.
Ideal Candidate Profile
- Experienced in large-scale enterprise environments, preferably Banking, Financial Services, or regulated industries.
- Capable of leading complex cross-functional initiatives integrating reliability, scalability, and performance best practices.
- Able to influence stakeholders and manage risk in data platform modernization and operational effectiveness.