Senior Software Engineer -Data Engineer-Databricks& Pyspark (Moisac AI)
Société GénéraleMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, and maintain scalable data engineering solutions on Databricks using PySpark, SQL, and Delta Lake focussing on performance, reliability, and cost efficiency.
Build and optimize batch and real-time data pipelines on AWS using services such as S3, Lambda, Glue, EMR, Redshift, and manage production operations including monitoring and troubleshooting.
Lead technical delivery including mentoring engineers, implementing data governance with Unity Catalog, CI/CD, infrastructure automation (Terraform), and participate in cloud migration and data platform modernization.
Minimum Requirements
5–8 years of experience in data engineering or related roles with deep hands-on expertise in Databricks (PySpark, SQL, Delta Lake).
Proven experience with Delta Live Tables (DLT) and Unity Catalog for data governance and processing in production environments.
Strong knowledge of AWS cloud services relevant to data pipelines (S3, Lambda, Glue, EMR, Redshift) and infrastructure automation (Terraform).
Work Experience Required: 5–8 years in relevant data engineering roles. Notice period: Not explicitly mentioned in the JD.
Ideal Candidate Profile
Senior-level engineer with proven track record designing and leading enterprise-scale data pipelines and AI-enabled data solutions on Databricks and AWS.
Experienced in mentoring engineers, driving architecture decisions, and aligning stakeholders in regulated or financial services domains preferred.
Able to manage platform reliability, perform Spark tuning, cost optimization, and apply data observability and FinOps practices in production data environments.