Lead Data Transformation Engineer - Google Cloud Platform (Remote or Hybrid)
Job Overview:
We are seeking a highly skilled Lead Data Transformation Engineer to join our team, driving the transformation of our client's legacy system to a cutting-edge Google Cloud Platform. As a seasoned data engineering expert, you will play a key role in rearchitecting, transforming, and redesigning data pipelines, collaborating with software engineers to deliver innovative solutions.
Key Responsibilities:
Design and implement large-scale data pipelines using Google Cloud Platform, Dataproc, Spark, and PySpark
Collaborate with architects to develop architecture solutions using Composer and Spark
Lead the migration of legacy systems to Google Cloud Platform, ensuring seamless integration and optimal performance
Develop and maintain CI/CD pipelines, ensuring efficient and reliable data processing
Work closely with cross-functional teams to identify and solve complex data engineering problems
Requirements:
10+ years of experience in data engineering, with a strong focus on data architecture and pipeline redesign
3+ years of experience with Google Cloud Platform, including migration expertise and experience with Dataproc and Spark
3+ years of experience with Apache Airflow and/or Composer
5+ years of experience with CI/CD pipelines
Strong proficiency in at least one OOP language, with Java preferred
Experience with databases, SQL, and large-scale batch processing using cloud services
Excellent collaboration and problem-solving skills, with the ability to work effectively with architects and engineers
What We Offer:
Competitive salary and benefits package
Remote or hybrid work arrangement, with the option to work from our Phoenix, AZ office
Opportunity to work with a leading client, driving innovation and transformation in their industry
Collaborative and dynamic work environment, with a team of experienced professionals
How to Apply:
If you are a motivated and experienced data engineering professional, looking to take your career to the next level, please apply now. We look forward to hearing from you!
Apply Now
Apply Now
We are seeking a highly skilled Lead Data Transformation Engineer to join our team, driving the transformation of our client's legacy system to a cutting-edge Google Cloud Platform. As a seasoned data engineering expert, you will play a key role in rearchitecting, transforming, and redesigning data pipelines, collaborating with software engineers to deliver innovative solutions.
Key Responsibilities:
Design and implement large-scale data pipelines using Google Cloud Platform, Dataproc, Spark, and PySpark
Collaborate with architects to develop architecture solutions using Composer and Spark
Lead the migration of legacy systems to Google Cloud Platform, ensuring seamless integration and optimal performance
Develop and maintain CI/CD pipelines, ensuring efficient and reliable data processing
Work closely with cross-functional teams to identify and solve complex data engineering problems
Requirements:
10+ years of experience in data engineering, with a strong focus on data architecture and pipeline redesign
3+ years of experience with Google Cloud Platform, including migration expertise and experience with Dataproc and Spark
3+ years of experience with Apache Airflow and/or Composer
5+ years of experience with CI/CD pipelines
Strong proficiency in at least one OOP language, with Java preferred
Experience with databases, SQL, and large-scale batch processing using cloud services
Excellent collaboration and problem-solving skills, with the ability to work effectively with architects and engineers
What We Offer:
Competitive salary and benefits package
Remote or hybrid work arrangement, with the option to work from our Phoenix, AZ office
Opportunity to work with a leading client, driving innovation and transformation in their industry
Collaborative and dynamic work environment, with a team of experienced professionals
How to Apply:
If you are a motivated and experienced data engineering professional, looking to take your career to the next level, please apply now. We look forward to hearing from you!
Apply Now
Apply Now