Experienced Big Data Engineer – Hadoop, Spark & Enterprise Data Platform Development
Join arenaflex as a Big Data Engineer
Are you ready to shape the future of data-driven technology at one of the world's most innovative financial services companies? At arenaflex, we're transforming how millions of customers interact with digital financial solutions, and we need talented engineers like you to help us build the next generation of data platforms that power exceptional customer experiences.
As a Big Data Engineer at arenaflex, you'll become an integral part of our diverse technology community where you can engineer, code, and ship programming that makes us an essential part of our customers' digital lives. Here, you'll work alongside skilled architects in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions about what technology to use to solve challenging problems. arenaflex offers a wide range of opportunities to work with the latest innovations and encourages you to contribute to the broader engineering community through open source contributions.
What You'll Do in This Role
As a member of our product engineering or delivery and integration team reporting to an Engineering Director, you'll be responsible for designing, developing, and maintaining our enterprise-grade data infrastructure. This is a hands-on technical role that requires both strong coding abilities and the capacity to lead and mentor other engineers.
Software Development
Intermediate to advanced level proficiency in software development using modern programming languages and frameworks
Function as a valuable member of an agile team by contributing to software works through consistent development practices including tools, common components, and comprehensive documentation
Participate in code reviews and automated testing to ensure code quality and maintainability
Troubleshoot critical software components and identify code defects for remediation
Enable the deployment, support, and monitoring of software across test, integration, and production environments
Automate deployments in test or production environments using industry-standard CI/CD pipelines
Automatically scale applications based on demand projections to ensure optimal performance
Leadership & Team Collaboration
Lead a small team of engineers and motivate them to achieve their full potential
Influence team members with innovative changes and improvements by challenging the norm and demonstrating calculated risk-taking
Mentor junior developers and contribute to their professional growth
Collaborate with cross-functional teams including data scientists, product managers, and business analysts
Data Platform Development
Design and build advanced data pipelines for both batch and real-time data processing using Hadoop ecosystem technologies
Create and test software, including ongoing refactoring of code and drive continuous improvement in code structure and quality
Spend primary focus writing code, API specifications, conducting code reviews, and testing in continuous runs or doing verification of concepts and automation tools
Apply visualization and other techniques to fast-track concepts from ideation to implementation
Function as a core member of an Agile team driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
Manage a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business need
Identify opportunities to embrace innovative technologies that improve our data platform capabilities
Embody an innovator with a purpose mindset by looking beyond the obvious for continuous improvement opportunities
Required Qualifications
We're looking for candidates who bring a combination of technical expertise, creative problem-solving abilities, and a passion for working with cutting-edge data technologies. The ideal candidate will have:
Bachelor's degree in Engineering, Computer Science, Information Systems, or related field; OR Master's in Computer Applications or equivalent practical experience
3+ years of software development experience with demonstrated ability to lead teams of developers and coordinate Scrum teams
3+ years of hands-on experience working with MapReduce, Hive, and Spark (core, SQL, and PySpark)
Strong data warehousing concepts and practical application experience
Working knowledge of financial reporting environments is a significant advantage
Expertise in distributed computing environments and their architecture
Hands-on experience in programming using Core Java or Python/Scala
Mastery of Hadoop and Spark Architecture and their operational standards
Experience writing and understanding complex SQL (Hive/PySpark dataframes), optimizing joins while processing large amounts of data
Experience in UNIX shell scripting for automation and data processing
Ability to design and develop advanced data pipelines for batch and continuous data processing
Experience in analysis, design, development, testing, and implementation of enterprise application systems
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing streams
Strong analytical and problem-solving skills with attention to detail
Excellent communication skills to effectively collaborate with technical and non-technical stakeholders
Preferred Qualifications
While not required, the following skills and experiences would make you an even stronger fit for this role:
Knowledge of cloud platforms like GCP or AWS, building microservices and scalable solutions
3+ years of experience designing and building solutions using Kafka streams or messaging queues
Experience with GitHub or Bitbucket and implementing CI/CD pipelines
Familiarity with NoSQL databases such as HBase, Couchbase, or MongoDB
Experience with machine learning workflows and data science pipelines
Strong technical and analytical aptitude with the ability to learn new technologies quickly
Excellent project management abilities and the capacity to handle multiple priorities
Why arenaflex? Career Growth & Development
At arenaflex, we understand that the technology landscape evolves rapidly, and keeping your skills fresh and relevant is essential. That's why we provide dedicated time and resources for you to invest in your professional development. You'll have access to comprehensive training programs, certifications, and mentorship opportunities that will help you grow both technically and professionally.
Our engineering culture celebrates innovation and continuous learning. You'll be encouraged to explore new technologies, contribute to open-source projects, and share your knowledge with the broader engineering community. We believe that when our engineers succeed, our company succeeds, and we're committed to providing the environment and resources you need to thrive.
This position offers significant career advancement opportunities within our technology organization. As you grow in your role, you'll have the chance to take on increased responsibilities, lead larger teams, and influence the technical direction of critical platform initiatives.
Work Environment & Culture
arenaflex fosters an inclusive, collaborative work environment where diversity of thought is celebrated. You'll join a fast-moving, entrepreneurial team that enables group analytics solutions using groundbreaking technologies including Hadoop, Big Data, Data Science, ML, Python, SQL, UNIX, and Shell Scripting to deliver innovative solutions across multiple lines of business.
We believe in work-life balance and offer flexible working arrangements to support your wellbeing. Our offices are designed to encourage collaboration and creativity, with open spaces for team discussions and quiet areas for focused work.
Compensation & Benefits
arenaflex offers a competitive compensation package that recognizes your skills and experience. This position offers an hourly rate of $28 per hour with opportunities for overtime, along with a comprehensive benefits package including:
Health, dental, and vision insurance coverage
401(k) retirement savings plan with company matching
Paid time off and holidays
Professional development reimbursement
Employee assistance programs
Various wellness programs and resources
Note: Employment with arenaflex is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.
Apply Today
If you're a passionate, high-performing engineer ready to help shape the future of technology at arenaflex, we want to hear from you. Bring your technical expertise, creativity, and collaborative spirit to a team that's transforming the financial services industry through innovative data solutions.
Find your place in technology with #TeamArenaflex and join us in building solutions that impact millions of customers worldwide. Your next career opportunity awaits!
Are you ready to shape the future of data-driven technology at one of the world's most innovative financial services companies? At arenaflex, we're transforming how millions of customers interact with digital financial solutions, and we need talented engineers like you to help us build the next generation of data platforms that power exceptional customer experiences.
As a Big Data Engineer at arenaflex, you'll become an integral part of our diverse technology community where you can engineer, code, and ship programming that makes us an essential part of our customers' digital lives. Here, you'll work alongside skilled architects in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions about what technology to use to solve challenging problems. arenaflex offers a wide range of opportunities to work with the latest innovations and encourages you to contribute to the broader engineering community through open source contributions.
What You'll Do in This Role
As a member of our product engineering or delivery and integration team reporting to an Engineering Director, you'll be responsible for designing, developing, and maintaining our enterprise-grade data infrastructure. This is a hands-on technical role that requires both strong coding abilities and the capacity to lead and mentor other engineers.
Software Development
Intermediate to advanced level proficiency in software development using modern programming languages and frameworks
Function as a valuable member of an agile team by contributing to software works through consistent development practices including tools, common components, and comprehensive documentation
Participate in code reviews and automated testing to ensure code quality and maintainability
Troubleshoot critical software components and identify code defects for remediation
Enable the deployment, support, and monitoring of software across test, integration, and production environments
Automate deployments in test or production environments using industry-standard CI/CD pipelines
Automatically scale applications based on demand projections to ensure optimal performance
Leadership & Team Collaboration
Lead a small team of engineers and motivate them to achieve their full potential
Influence team members with innovative changes and improvements by challenging the norm and demonstrating calculated risk-taking
Mentor junior developers and contribute to their professional growth
Collaborate with cross-functional teams including data scientists, product managers, and business analysts
Data Platform Development
Design and build advanced data pipelines for both batch and real-time data processing using Hadoop ecosystem technologies
Create and test software, including ongoing refactoring of code and drive continuous improvement in code structure and quality
Spend primary focus writing code, API specifications, conducting code reviews, and testing in continuous runs or doing verification of concepts and automation tools
Apply visualization and other techniques to fast-track concepts from ideation to implementation
Function as a core member of an Agile team driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
Manage a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business need
Identify opportunities to embrace innovative technologies that improve our data platform capabilities
Embody an innovator with a purpose mindset by looking beyond the obvious for continuous improvement opportunities
Required Qualifications
We're looking for candidates who bring a combination of technical expertise, creative problem-solving abilities, and a passion for working with cutting-edge data technologies. The ideal candidate will have:
Bachelor's degree in Engineering, Computer Science, Information Systems, or related field; OR Master's in Computer Applications or equivalent practical experience
3+ years of software development experience with demonstrated ability to lead teams of developers and coordinate Scrum teams
3+ years of hands-on experience working with MapReduce, Hive, and Spark (core, SQL, and PySpark)
Strong data warehousing concepts and practical application experience
Working knowledge of financial reporting environments is a significant advantage
Expertise in distributed computing environments and their architecture
Hands-on experience in programming using Core Java or Python/Scala
Mastery of Hadoop and Spark Architecture and their operational standards
Experience writing and understanding complex SQL (Hive/PySpark dataframes), optimizing joins while processing large amounts of data
Experience in UNIX shell scripting for automation and data processing
Ability to design and develop advanced data pipelines for batch and continuous data processing
Experience in analysis, design, development, testing, and implementation of enterprise application systems
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing streams
Strong analytical and problem-solving skills with attention to detail
Excellent communication skills to effectively collaborate with technical and non-technical stakeholders
Preferred Qualifications
While not required, the following skills and experiences would make you an even stronger fit for this role:
Knowledge of cloud platforms like GCP or AWS, building microservices and scalable solutions
3+ years of experience designing and building solutions using Kafka streams or messaging queues
Experience with GitHub or Bitbucket and implementing CI/CD pipelines
Familiarity with NoSQL databases such as HBase, Couchbase, or MongoDB
Experience with machine learning workflows and data science pipelines
Strong technical and analytical aptitude with the ability to learn new technologies quickly
Excellent project management abilities and the capacity to handle multiple priorities
Why arenaflex? Career Growth & Development
At arenaflex, we understand that the technology landscape evolves rapidly, and keeping your skills fresh and relevant is essential. That's why we provide dedicated time and resources for you to invest in your professional development. You'll have access to comprehensive training programs, certifications, and mentorship opportunities that will help you grow both technically and professionally.
Our engineering culture celebrates innovation and continuous learning. You'll be encouraged to explore new technologies, contribute to open-source projects, and share your knowledge with the broader engineering community. We believe that when our engineers succeed, our company succeeds, and we're committed to providing the environment and resources you need to thrive.
This position offers significant career advancement opportunities within our technology organization. As you grow in your role, you'll have the chance to take on increased responsibilities, lead larger teams, and influence the technical direction of critical platform initiatives.
Work Environment & Culture
arenaflex fosters an inclusive, collaborative work environment where diversity of thought is celebrated. You'll join a fast-moving, entrepreneurial team that enables group analytics solutions using groundbreaking technologies including Hadoop, Big Data, Data Science, ML, Python, SQL, UNIX, and Shell Scripting to deliver innovative solutions across multiple lines of business.
We believe in work-life balance and offer flexible working arrangements to support your wellbeing. Our offices are designed to encourage collaboration and creativity, with open spaces for team discussions and quiet areas for focused work.
Compensation & Benefits
arenaflex offers a competitive compensation package that recognizes your skills and experience. This position offers an hourly rate of $28 per hour with opportunities for overtime, along with a comprehensive benefits package including:
Health, dental, and vision insurance coverage
401(k) retirement savings plan with company matching
Paid time off and holidays
Professional development reimbursement
Employee assistance programs
Various wellness programs and resources
Note: Employment with arenaflex is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.
Apply Today
If you're a passionate, high-performing engineer ready to help shape the future of technology at arenaflex, we want to hear from you. Bring your technical expertise, creativity, and collaborative spirit to a team that's transforming the financial services industry through innovative data solutions.
Find your place in technology with #TeamArenaflex and join us in building solutions that impact millions of customers worldwide. Your next career opportunity awaits!