Lead II - Data Engineering

Lead architectural design and execution to consolidate separate Databricks workspaces or Snowflake accounts into a unified data platform.

Unify metadata catalogs, security models, and access controls across merged data environments to ensure consistent governance.

Refactor and migrate legacy ETL/ELT pipelines and workflows, optimize cloud resources by identifying overlaps during tenant consolidation.

4-6 years of experience in Data Platform Engineering or Data Architecture.

Proven experience managing AWS cloud infrastructure components including S3, IAM, CloudTrail, VPC, and Route53 with cross-account access expertise.

Deep expertise in either Databricks platform administration (workspace, Delta Lake, Photon) OR Snowflake (multi-account management, Snowpark, Virtual Warehouses).

Strong skills in Infrastructure as Code (Terraform), Python programming, and SQL for auditing and refactoring data pipelines.

Experienced technical lead capable of planning and coordinating complex data platform migrations and cloud account consolidations.

Proficient in managing and optimizing cloud data platforms with attention to security, governance, and cost efficiency.

Background in working with cross-functional teams to audit, refactor, and migrate distributed data workflows and infrastructure.