Databricks Data Engineer
Hitachi Solutions America, Ltd.Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design, develop, enhance, and maintain complex Databricks-based data pipelines and API products supporting business-critical operations and large-scale analytics.
Collaborate with engineering leadership and cross-functional teams to architect scalable Big Data systems with minimal oversight.
Contribute to the technical maturity of the organization with strong autonomy and continuous learning of evolving data engineering technologies.
Minimum Requirements
5+ years of Data Engineering experience, including at least 4 years designing and building Databricks data pipelines.
4+ years of hands-on experience with Python, PySpark, or SparkSQL and Spark, especially with Databricks Spark and Delta Lake.
4+ years of experience with Big Data pipelines or DAG tools such as Airflow, Dbt, or Data Factory.
Experience implementing Big Data solutions in cloud ecosystems (Azure preferred; AWS or GCP also considered).
Ideal Candidate Profile
Deep expertise in Databricks Spark and Delta Lake technologies, with operational ownership of enterprise-level data pipelines.
Proven ability to design, implement, and maintain scalable and complex Big Data architectures in cloud environments.
Experience working independently and collaborating with cross-functional teams to deliver business-critical data products.