Agentic AI Engineer in Test

Santander Bank, N.A. is a global leader in financial services, evolving into a technology-driven organization. The Agentic AI Engineer will design, build, and deploy autonomous AI agents powered by large language models, collaborating with various teams to create intelligent systems for enterprise environments.ResponsibilitiesDesign and implement agentic systems with planning, reasoning, memory, tool use, and multi-step workflowsBuild LLM-powered pipelines using frameworks such as LangChain, AutoGen, Llama Index, or custom runtimesImplement MCP (Model Context Protocol) or similar protocols for secure and governed tool/API accessIntegrate agents with APIs, microservices, workflows, distributed systems, and enterprise platformsDevelop retrieval pipelines (RAG), embeddings, memory stores, and prompt strategies, frameworks so as LLM/RAG test automation solutionsImplement observability, telemetry, and monitoring for agent decisions and tool interactionsBuild CI/CD, automation, and MLOps practices for agent deploymentSkillsBachelor's Degree or equivalent work experience: Computer Science, Software Engineering or equivalent field0+ Years Experience with test strategies, test plans, and test casesExperience in writing SQLs to query the backend during the test executionExpertise in testing web based applications and web services based systems with minimal to no user interfaceExperience building test automation frameworks for AI/ML or distributed systemsUnderstanding of LLM evaluation techniques (BLEU, factuality checks, grounding scores, custom metrics)Ability to debug agent reasoning errors, hallucinations, planning failures, and tool misuseKnowledge of testing RAG systems (retrieval correctness, latency, vector search quality)Experience with structured testing for tool calls, MCP tools, API integrations, and orchestration chainsStrong skills in observability, log analysis, and test data managementAbility to apply responsible AI and safety testing practicesExperience integrating AI with internal tools, data sources, and enterprise servicesCloud engineering experience (AWS/Azure/GCP) and containerization (Docker, Kubernetes)Understanding of AI governance, responsible AI, and compliance requirementsExperience with JIRA/ALM/Xray or similar toolsStrong analytical, communication, documentation, and problem-solving skillsAbility to manage workload, collaborate in Agile teams, effectively, and work independentlyEstablished work history or equivalent demonstrated through a combination of work experience, training, military service, or educationExperience in Microsoft Office productsBenefitsFair and competitive rewards packageBenefits are designed to support you, your family and your well-being, now and into the futureCompany OverviewAt Santander Bank, it’s our mission to help people and businesses prosper. It was founded in 2013, and is headquartered in Boston, Massachusetts, USA, with a workforce of 5001-10000 employees. Its website is https://www.santanderbank.com.Company H1B SponsorshipSantander Bank, N.A. has a track record of offering H1B sponsorships, with 44 in 2025, 36 in 2024, 61 in 2023, 66 in 2022, 78 in 2021, 69 in 2020. Please note that this does not guarantee sponsorship for this specific role.



Apply Now