Back
Mid-level Big Data role in Bangalore with broad skill requirements and popular title increases competition.
Data engineering skills (Python, PySpark, ETL) are widely transferable across industries.
Explicit 6+ years requirement plus mandatory PySpark, Python, Kubernetes, and IaC skills make screening strict.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Design, develop, and maintain scalable Python and PySpark applications and large-scale data processing pipelines.
Develop and manage CI/CD pipelines using GitHub Actions, containerized environments, and deploy on Kubernetes/OpenShift platforms.
Automate infrastructure provisioning with Infrastructure-as-Code tools, monitor and optimize application and infrastructure performance, ensuring security compliance and operational standards.
6+ years of software development experience.
Proficient in Python coding and PySpark development.
Experience with DevOps tools: GitHub Actions, containers (podman), OpenShift/Kubernetes, CI/CD pipelines, Linux OS and scripting, infrastructure-as-code.
Bachelor's degree in computer science or related field with at least 3 years of relevant experience.
Experienced engineer with strong expertise in big data processing and Python/PySpark development.
Hands-on with DevOps automation, container orchestration (Kubernetes/OpenShift), and infrastructure-as-code in production environments.
Familiarity with cloud-native tools (AWS Lambda, ECS, Azure Functions) and secondary experience with Cloudera (CDP) and concepts like LLMs and RAG.