4–6 yrsKarnatakaOn-siteDirect career pageEst. 10–20 LPA
Posted 4d ago
Reach people at CNX Resources Corporation
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at CNX Resources Corporation you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Own the design, development, and maintenance of scalable ETL/ELT pipelines for structured and semi-structured data using Azure Databricks, Spark, Python, and SQL.
- Deliver production-grade batch data processing with Delta Lake; optimize pipelines, jobs, queries, and clusters for performance and cost, and resolve production failures and data-quality issues.
- Implement data validation, monitoring, security, documentation, and automated deployment practices for reliable data solutions.
Minimum Requirements
- Work Experience Required: 4–6 years of relevant data engineering experience on cloud-based data platforms.
- Hands-on expertise in Azure Databricks, PySpark, Apache Spark, Python, advanced SQL, and scalable ETL/ELT development.
- Experience with Delta Lake and Azure Data Lake Storage and Azure Data Factory; knowledge of Spark/Databricks performance optimization is required.
- Experience with Git-based version control and CI/CD/DevOps practices. Location: Bangalore (IND Bangalore - MTP C4, 3rd Flr); work arrangement: Not explicitly mentioned in the JD.
Ideal Candidate Profile
- Has hands-on experience building and operating reliable, production-grade data pipelines, including batch and large-scale processing.
- Can improve pipeline performance and cost through Spark and Databricks optimization, and troubleshoot operational and data-quality issues.
- Can translate requirements into documented, secure data solutions while coordinating with data architects, analysts, application teams, and business stakeholders.