Actively looking for a AWS Data Engineer
Role: AWS Data Engineer
Location: Remote
Mail:
Role Summary:
The Data Engineer will build and maintain secure, scalable, and automated data pipelines to support the ingestion, transformation, and curation of data products. This role will focus on implementing CI/CD pipelines, automated testing, and monitoring solutions.
Key Responsibilities:
Data Pipelines:
ā¢ Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
Automation:
ā¢ Implement CI/CD pipelines for automated build, test, and deployment of data products.
Testing:
ā¢ Establish automated test frameworks for schema validation, data quality, and performance testing.
Monitoring:
ā¢ Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics).
Collaboration:
ā¢ Work with data modelers and architects to ensure alignment with business requirements.
Required Skills:
Programming:
ā¢ Proficiency in Python, SQL, and shell scripting.
AWS Expertise:
ā¢ Hands-on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
Automation:
ā¢ Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
Data Integration:
ā¢ Strong knowledge of ETL/ELT processes and frameworks.
Soft Skills:
ā¢ Strong problem-solving, collaboration, and communication skills.
Qualifications:
ā¢ Bachelor s degree in computer science, Data Engineering, or related field.
ā¢ 10+ years of experience in data engineering and pipeline development.
ā¢ AWS Certified Data Analytics or AWS Certified Developer is a plus.
Apply Now
Apply Now
Location: Remote
Mail:
Role Summary:
The Data Engineer will build and maintain secure, scalable, and automated data pipelines to support the ingestion, transformation, and curation of data products. This role will focus on implementing CI/CD pipelines, automated testing, and monitoring solutions.
Key Responsibilities:
Data Pipelines:
ā¢ Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift.
Automation:
ā¢ Implement CI/CD pipelines for automated build, test, and deployment of data products.
Testing:
ā¢ Establish automated test frameworks for schema validation, data quality, and performance testing.
Monitoring:
ā¢ Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics).
Collaboration:
ā¢ Work with data modelers and architects to ensure alignment with business requirements.
Required Skills:
Programming:
ā¢ Proficiency in Python, SQL, and shell scripting.
AWS Expertise:
ā¢ Hands-on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch).
Automation:
ā¢ Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline).
Data Integration:
ā¢ Strong knowledge of ETL/ELT processes and frameworks.
Soft Skills:
ā¢ Strong problem-solving, collaboration, and communication skills.
Qualifications:
ā¢ Bachelor s degree in computer science, Data Engineering, or related field.
ā¢ 10+ years of experience in data engineering and pipeline development.
ā¢ AWS Certified Data Analytics or AWS Certified Developer is a plus.
Apply Now
Apply Now