**Experienced Senior Data Engineer – Cloud-Based Data Pipeline Development and Business Intelligence Solutions**
About Us At Workwarp, we're a dynamic and innovative company that's revolutionizing the way businesses approach data-driven decision-making. Our team of experts is dedicated to delivering cutting-edge solutions that help our clients stay ahead of the curve in today's fast-paced digital landscape. As a Senior Data Engineer on our team, you'll play a critical role in shaping the future of our company and helping our clients achieve their goals. Job Summary We're seeking an experienced Senior Data Engineer to join our team and help us develop and implement cloud-based data pipeline solutions that drive business intelligence and inform strategic decision-making. As a Senior Data Engineer, you'll be responsible for designing, building, and maintaining complex data pipelines, as well as collaborating with cross-functional teams to ensure seamless integration and deployment of our solutions. If you're a seasoned data professional with a passion for innovation and a drive to deliver exceptional results, we want to hear from you! Key Responsibilities Data Strategy: Develop and implement data strategies that align with business objectives and drive business intelligence. Data Pipeline Development: Design, build, and maintain complex data pipelines using memory-aware computing frameworks like Apache Spark. Data Application Development: Design and build robust data applications to collect and transform data using Apache Hive. Data Transformation: Design and implement data transformations using user-defined functions (UDFs) using Java. Data Ingestion: Develop a data ingestion pipeline using Sqoop. Cloud Application Development: Build, monitor, support, migrate, maintain, support, and deploy cloud applications and data. Automation: Create automation applications using shell scripts. Problem-Solving: Convert business problems into mathematical or data-driven solutions using analytics, big data analysis, and automation. Business Acumen: Provide advice to entrepreneurs to solve complex business problems and create business cases for projects with expected return on investment or cost savings. Data Governance: Develop, modify, and document data governance and advisory strategies, conduct data management processes, and describe corporate data standards and regulations. Requirements To be successful in this role, you'll need to have a strong foundation in computer science, information technology, engineering, or a related field, as well as 3-5 years of experience in software engineering or a related field. A bachelor's degree or equivalent is required, but a master's degree or equivalent in computer science, information technology, engineering, or a related field is preferred. You'll also need to have experience in the following areas: Designing and building data entry and processing pipelines using memory-aware computing frameworks like Apache Spark. Designing and building robust data applications to collect and transform data using Apache Hive. Designing and implementing data transformations using user-defined functions (UDFs) using Java. Developing a data ingestion pipeline using Sqoop. Creating data applications using the Scala functional programming language. Creating automation applications using shell scripts. Building, monitoring, supporting, migrating, maintaining, supporting, and deploying cloud applications and data. Creating data processing tools and resources using Python. Creating a real-time data entry application using Apache Kafka. Developing complex SQL applications and optimizing query performance for various databases like Postgres. Creating unit test cases using test frameworks like Pytest. Content/project management tools like Confluence and JIRA. Developing applications according to the Agile SDLC process. Creating a REST API using the Java framework. What We Offer As a Senior Data Engineer at Workwarp, you'll enjoy a competitive salary, comprehensive benefits package, and opportunities for professional growth and development. You'll also be part of a dynamic and innovative team that's passionate about delivering exceptional results and making a real impact in the world. How to Apply If you're a seasoned data professional with a passion for innovation and a drive to deliver exceptional results, we want to hear from you! Please submit your application, including your resume and a cover letter, to [insert contact information]. We can't wait to hear from you and discuss how you can become a vital part of our success story! Apply for this job