Software Engineer - LLM & Automation

Job Description: • About Basis: Basis is a nonprofit applied AI research organization with two mutually reinforcing goals. • Understand and build intelligence: Establish the mathematical principles of reasoning, learning, decision-making, understanding, and constructing software that embodies these principles. • Advance society’s ability to solve intractable problems: Expanding the scale, complexity, and breadth of problems we can solve today and accelerating our ability to solve problems in the future. • Building scalable systems that integrate large language models (LLMs) with operational workflows. • Designing and deploying automated “pipelines” for tasks like recruiting, finance, and project management—often powered by LLMs. • Hiring contractors, part-time, or full-time teammates. Requirements: • Have experience programming in Julia and/or Python (3+ years of production-level coding, or equivalent) • Understand how to integrate LLMs using structured prompts, scaffolding frameworks (LangChain-like), or advanced text generation approaches • Can handle concurrency, scaling, and performance optimizations in real-world deployments • Are comfortable with complex API orchestration: dealing with rate limits, OAuth, error retries, etc. • Have good collaboration and communication skills, especially when gathering requirements from non-technical staff • Are flexible and creative problem solvers, comfortable with iterative, experimental development cycles • Embrace data-security best practices (e.g., handling PII, encryption, secrets management) • Are excited to learn quickly and adapt to new developments in the LLM/AI ecosystem • Preferred (not all required): • Julia: Type-driven or multiple-dispatch approaches; performance tuning, HPC, or scientific computing workflows • Python: Building microservices with FastAPI, Flask, or other frameworks; advanced concurrency (async, multiprocessing) • LLM Tools & Frameworks: Familiarity with LangChain, open source LLM clients, or custom chain-of-thought integrations • Cloud Infrastructure: Docker/Kubernetes, CI/CD pipelines, AWS/GCP/Azure deployment patterns • Distributed Systems & Queues: Experience with concurrent processing, task queues (Celery, Sidekiq), or event-driven systems • Database Interaction: Ability to design schemas and queries in PostgreSQL or similar databases • Security & Privacy: Understanding of OAuth flows, secrets management, data encryption, and role-based access controls Benefits: Apply tot his job