Sr Data Engineer (AF) - Onsite Austin, TX
Data Engineer (L1 or L2 Or L3 Level any)
Location: Fort Mill or Austin (Hybrid)
We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives.
Required Skills & Qualifications:
· Experience in Data Engineering or a related field.
· Strong proficiency in AWS (S3, Glue, Lambda, EMR, Redshift, etc.) for cloud-based data processing.
· Hands-on experience with Python for data processing and automation.
· Expertise in Apache Spark for distributed data processing.
· Solid understanding of ETL pipeline design and data warehousing concepts.
· Proficiency in SQL for querying and managing relational databases.
· Experience writing unit and integration tests using Pytest.
· Familiarity with CI/CD pipelines and version control systems (e.g., Git).
· Strong problem-solving skills and ability to work in a fast-paced environment.
Preferred Qualifications:
· Experience with Terraform, Docker, or Kubernetes.
· Knowledge of big data tools such as Apache Kafka or Airflow.
· Exposure to data governance and security best practices.
Job Type: Full-time
Pay: $120,000.00 - $140,000.00 per year
Benefits:
401(k)
Health insurance
Compensation Package:
Yearly pay
Schedule:
8 hour shift
Work Location: On the road
Apply Now
Location: Fort Mill or Austin (Hybrid)
We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives.
Required Skills & Qualifications:
· Experience in Data Engineering or a related field.
· Strong proficiency in AWS (S3, Glue, Lambda, EMR, Redshift, etc.) for cloud-based data processing.
· Hands-on experience with Python for data processing and automation.
· Expertise in Apache Spark for distributed data processing.
· Solid understanding of ETL pipeline design and data warehousing concepts.
· Proficiency in SQL for querying and managing relational databases.
· Experience writing unit and integration tests using Pytest.
· Familiarity with CI/CD pipelines and version control systems (e.g., Git).
· Strong problem-solving skills and ability to work in a fast-paced environment.
Preferred Qualifications:
· Experience with Terraform, Docker, or Kubernetes.
· Knowledge of big data tools such as Apache Kafka or Airflow.
· Exposure to data governance and security best practices.
Job Type: Full-time
Pay: $120,000.00 - $140,000.00 per year
Benefits:
401(k)
Health insurance
Compensation Package:
Yearly pay
Schedule:
8 hour shift
Work Location: On the road
Apply Now