Senior Data Engineer – Enterprise Data Frameworks (Java Spark Focus)

Remote Full-time
About the positionSenior Data Engineer – Enterprise Data Frameworks OverviewThe Enterprise Data Frameworks team is seeking aSenior Data Engineer with deep expertise in building scalable, high-performance data processing systems using Java, Apache Spark, and modern data engineering tools. This role is ideal for someone passionate about designing resilient data frameworks, optimizing distributed data pipelines, and enabling enterprise-grade data onboarding and automation. As aSenior Data Engineer, you will lead the development of core components within our data frameworks, integrating Spark-based processing with backend services and APIs.You will collaborate with architects, data engineers, and business stakeholders to deliver secure, compliant, and high-performing solutions. Responsibilities • Design and implement distributed data processing pipelines using Apache Spark (Java) for large-scale data ingestion, transformation, and analytics • Develop and maintain Java-based microservices and APIs to support data workflows and framework orchestration • Collaborate with UI engineers to integrate backend services with frontend applications for seamless user experiences • Translate business and technical requirements into scalable data engineering solutions • Optimize Spark jobs for performance, reliability, and bolthires-efficiency across cloud and on-prem environments • Lead code reviews, mentor junior engineers, and contribute to architectural decisions • Ensure compliance with data governance, security, and change management standards • Participate in Agile ceremonies and drive continuous improvement in engineering practices Requirements • 7+ years of experience in data engineering with strong proficiency in Java and Apache Spark • Proven experience building and optimizing Spark jobs for batch and streaming data • Solid understanding of data lake architectures, Iceberg/Parquet, and metadata-driven frameworks • Experience with Spring Boot, RESTful APIs, and microservices architecture • Familiarity with bolthires/CD pipelines, Git, and containerization (Docker/Kubernetes) • Exposure to cloud platforms such as AWS (S3, EMR, Lambda, API Gateway) is a plus • Experience working with data-centric applications and collaborating with frontend and platform teams • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field Nice-to-haves • Experience with Generative AI tools or frameworks for developer assistance, metadata analysis, or automation Benefits • We offer competitive pay, comprehensive medical, dental and vision coverage, retirement benefits, maternity/paternity leave, flexible work arrangements, education reimbursement, wellness programs and more.• Note, Citizens’ paid time off policy exceeds the mandatory, paid sick or paid time-away policy of very local and state jurisdiction in the United States. • For an overview of our benefits, visit Apply tot his job
Apply Now

Similar Opportunities

Staff Data Scientist (Loss Forecasting & Portfolio Analytics)

Remote Full-time

Financial Crime Data Analyst, SQL & Large Data Sets

Remote Full-time

Equity Operational Risk Analyst, Specialist

Remote Full-time

Financial Audit Analyst (Client Audit) - EVERNORTH

Remote Full-time

[Remote] FINANCIAL ANALYST, FCH - BUDGET AND FINANCIAL PLANNING

Remote Full-time

Financial Analyst (Financial Analyst 2) (Remote) - 21799

Remote Full-time

Partner – Technology Enabled Finance Transformation

Remote Full-time

Finance Business Analyst (ERP, SaaS Billing Systems and Credit/Collection Systems)

Remote Full-time

Financial Analyst, Operations

Remote Full-time

Financial Analyst - US HVT Operations

Remote Full-time

[Remote] Salesforce Incident Management Analyst

Remote Full-time

bolthires Senior UX/UI Designer (Remote) in Harrisburg, Pennsylvania

Remote Full-time

Experienced Customer Service Representative – Remote Opportunity with arenaflex

Remote Full-time

[Remote] Business Analyst, Field Inventory (Remote)

Remote Full-time

Experienced Online Data Entry Assistant for Teenagers – Entry-Level Opportunity in Online Administrative Tasks and Data Management at arenaflex

Remote Full-time

[Remote] Associate Account Manager

Remote Full-time

Experienced Data Entry Specialist – Flexible Work-from-Home Opportunity with arenaflex

Remote Full-time

Application Architect

Remote Full-time

Experienced Customer Service Representative – Online Support Team at arenaflex

Remote Full-time

Allstate Sales Agent (Kingston)

Remote Full-time
← Back to Home