Senior Associate-Data Engineer
Acuity AnalyticsMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, construct, and maintain scalable data management systems using Azure Databricks and associated Azure services.
Lead and oversee the data engineering module through planning, estimation, implementation, monitoring, and tracking workflows.
Develop and optimize data processing pipelines using PySpark, Python, SQL, and maintain documentation and data governance standards.
Minimum Requirements
5-7 years of software development experience focused on data engineering using Python, PySpark, and Azure cloud services.
Proven experience with Azure cloud ecosystem including Azure Data Factory, Lake Gen 2, Databricks, API Gateway, and Azure Functions.
Strong SQL skills with relational and NoSQL databases, with experience in building APIs using frameworks like FastAPI.
Work Experience Required: 5-7 years; Location: Bengaluru, Karnataka, India; Employee Type: Permanent.
Ideal Candidate Profile
Experienced data engineer comfortable leading module delivery including planning and monitoring in an enterprise environment.
Demonstrated expertise in building, optimizing, and maintaining data pipelines and infrastructures using Azure Databricks and related technologies.
Ability to engage with both technical and non-technical stakeholders, troubleshoot complex data issues, and deliver under demanding timelines.