Experienced Data Engineer – Remote Full-Time Opportunity with arenaflex for All Levels of Expertise in Data Pipeline Development and Maintenance

Introduction to arenaflex and the Industry arenaflex is a leading player in the private industry, committed to innovation and excellence in all aspects of its operations. As a key contributor to the data engineering team, you will play a vital role in supporting the design, build, test, and maintenance of data pipelines at a large scale. The data engineering field is rapidly evolving, with a growing demand for skilled professionals who can manage and analyze complex data sets. At arenaflex, we recognize the importance of data-driven insights in driving business decisions and are seeking a talented Data Engineer to join our team. Job Overview We are seeking an experienced Data Engineer to work on the development and maintenance of our data pipelines. As a Data Engineer at arenaflex, you will be responsible for supporting the plan, build, test, and maintenance of data pipelines at a large scale. You will work on updating data from multiple data sources, batch processing of collected data, and ensuring that the data is properly formatted and stored. You will also be responsible for investigating performance issues, data-related problems, and providing level 3 support. If you have a passion for working with data and are looking for a challenging and rewarding role, we encourage you to apply. Key Responsibilities Support the design, build, test, and maintenance of data pipelines at a large scale Update data from multiple data sources and perform batch processing of collected data Ensure that the data is properly formatted and stored, and investigate performance issues and data-related problems Provide level 3 support and implement parsers, validators, transformers, and correlators to reformat, update, and upgrade the data Collaborate with cross-functional teams to deliver value and drive business decisions Work on code reviews and large-scale solutions, and provide guidance to less senior team members Essential Qualifications To be successful in this role, you will need to have a Bachelor's degree in a relevant field, such as computer science or engineering. You will also need to have a strong technical foundation in software engineering, programming, database systems, and distributed systems. Experience with Microsoft Azure and knowledge of CI/CD pipelines are also essential. Additionally, you will need to have excellent problem-solving skills, with the ability to work at the code level and help troubleshoot complex issues. Preferred Qualifications While not essential, experience with DevOps and knowledge of tools such as Terraform, YAML, and JSON are highly desirable. You will also need to have a strong understanding of transportation and logistics, with the ability to identify high-opportunity areas and design approaches and solutions that generate and capture value. Experience with big data tools such as HDFS, Kafka, and Spark is also preferred, as well as knowledge of SQL and NoSQL storage devices, such as MySQL, Postgres, Cassandra, MongoDB, and ElasticSearch. Skills and Competencies To be successful in this role, you will need to have a range of skills and competencies, including: Technical expertise in software engineering, programming, database systems, and distributed systems Strong problem-solving skills, with the ability to work at the code level and help troubleshoot complex issues Excellent communication and collaboration skills, with the ability to work with cross-functional teams Strong understanding of transportation and logistics, with the ability to identify high-opportunity areas and design approaches and solutions that generate and capture value Experience with DevOps and knowledge of tools such as Terraform, YAML, and JSON Knowledge of big data tools such as HDFS, Kafka, and Spark, as well as SQL and NoSQL storage devices Career Growth Opportunities and Learning Benefits At arenaflex, we are committed to the growth and development of our employees. As a Data Engineer, you will have the opportunity to work on challenging and rewarding projects, and to develop your skills and expertise in a range of areas. You will also have access to training and development programs, as well as opportunities for career advancement and professional growth. Work Environment and Company Culture arenaflex is a dynamic and innovative company, with a strong focus on teamwork and collaboration. Our work environment is fast-paced and challenging, but also supportive and rewarding. We recognize the importance of work-life balance and offer a range of benefits and perks to support our employees' well-being and happiness. Compensation, Perks, and Benefits We offer a competitive salary of $28 per hour, as well as a range of benefits and perks, including: Comprehensive health and dental insurance 401(k) matching program Paid time off and holidays Professional development opportunities Access to cutting-edge technology and tools Conclusion If you are a motivated and talented Data Engineer looking for a challenging and rewarding role, we encourage you to apply for this exciting opportunity at arenaflex. With a strong focus on innovation, teamwork, and employee growth and development, we offer a dynamic and supportive work environment that is perfect for professionals who are passionate about data engineering and want to make a real impact. Apply now to join our team and take your career to the next level! Apply! Apply for this job