Sr. Data Engineer - Remote (EST or CST)/ Travel quarterly for PI planning
Sr. Data Engineer
Remote (working CST or EST) and able to travel quarterly for PI planning
6 months contract-to-hire
Candidate resume should be 2 pages max
Video recorded technical screening is required
Job Summary
Our fortune 500 food industry client is looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.
Key skills include
Strong Snowflake expertise
Advanced SQL proficiency
Data extraction from APIs using Python and AWS Lambda
Experience with ETL/ELT processes
Workflow automation using AWS Airflow is essential, and
Experience with Fivetran and DBT.
Job Responsibilities
• Design, build, test, and implement scalable data pipelines using Python and SQL.
• Maintain and optimize our Snowflake data warehouse s performance, including data ingestion and query optimization.
• Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
• Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
• Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
• Maintain code via CI/CD processes as defined in our Azure DevOps platform.
Job Qualifications
• 7+ years of experience in Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion.
• Expertise in Snowflake, including data ingestion and performance optimization.
• Strong SQL skills for writing efficient queries and optimizing existing ones.
• Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc.
• Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc.
• Highly self-motivated and detail-oriented with strong communication skills.
• Familiarity with ETL/ELT processes.
• Experience with Fivetran and DBT.
Apply Now
Apply Now
Remote (working CST or EST) and able to travel quarterly for PI planning
6 months contract-to-hire
Candidate resume should be 2 pages max
Video recorded technical screening is required
Job Summary
Our fortune 500 food industry client is looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing, building, and maintaining our data infrastructure, focusing on creating scalable pipelines, ensuring data integrity, and optimizing performance.
Key skills include
Strong Snowflake expertise
Advanced SQL proficiency
Data extraction from APIs using Python and AWS Lambda
Experience with ETL/ELT processes
Workflow automation using AWS Airflow is essential, and
Experience with Fivetran and DBT.
Job Responsibilities
• Design, build, test, and implement scalable data pipelines using Python and SQL.
• Maintain and optimize our Snowflake data warehouse s performance, including data ingestion and query optimization.
• Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
• Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
• Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
• Maintain code via CI/CD processes as defined in our Azure DevOps platform.
Job Qualifications
• 7+ years of experience in Data Engineering roles, with a focus on building and implementing scalable data pipelines for data ingestion.
• Expertise in Snowflake, including data ingestion and performance optimization.
• Strong SQL skills for writing efficient queries and optimizing existing ones.
• Proficiency in Python for data extraction from APIs using AWS Lambda, Glue, etc.
• Experience with AWS services such as Lambda, Airflow, Glue, S3, SNS, etc.
• Highly self-motivated and detail-oriented with strong communication skills.
• Familiarity with ETL/ELT processes.
• Experience with Fivetran and DBT.
Apply Now
Apply Now