#111 - Data Engineer
Lifted (an Upwork company) (company site, opens in a new tab)2+ yrsHyderabadRemoteDirect career pageEst. 8–18 LPA
Posted on 8 Oct
Reach people at Lifted (an Upwork company)
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Lifted (an Upwork company) you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Migrate approximately 1,000 datasets to Snowflake including adapting and maintaining existing data pipelines with high quality and reliability.
- Execute migration of pipelines from Apache Airflow 2 to Airflow 3, Hive to Iceberg using Snowpark Connect, and manage Confluent connections across cloud regions.
- Support workflow scheduling, monitoring, and deliver time-sensitive data migrations in a large-scale data platform modernization through March 2027.
Minimum Requirements
- Minimum 2 years industry experience working with large-scale datasets and tools including Apache Airflow and Spark.
- Proficient in Python development and advanced SQL (complex joins, CTEs, window functions, performance tuning).
- Experience with Snowflake data modeling, Apache Airflow, Apache Kafka, Apache Spark/PySpark, Iceberg and Parquet data formats, and AWS S3.
- Must be located in eligible EMEA or APAC locations with ability to cover until 12:00 PM Pacific Time; remote 40 hours/week contract through March 31, 2027.
Ideal Candidate Profile
- Experience specifically in migrating data platforms including Snowflake and Apache Airflow version upgrades or migrations.
- Strong hands-on implementation skills within defined architectures in enterprise-scale environments.
- Comfortable operating independently on complex, time-sensitive data migration projects with reliable delivery focus.