Software Engineer, AI
ImmunityBio, Inc.
June 27, 2026
Remote friendly (California, United States)
United States
IT
Position Summary
The Software Engineer – AI is a hands-on role integrating data engineering, software development, and AI agent architecture, working with platform engineering, data science, security, and product teams to implement production-grade AI systems.
Essential Functions
- Design, develop, maintain, and deploy AI agent systems (LangGraph StateGraph patterns, CrewAI, LlamaIndex, or related frameworks).
- Build FastAPI-based agent servers (async/await, streaming, health checks).
- Implement testing (unit, integration, edge-case, performance) for production reliability.
- Implement AI guardrails (input/output validation, safety checks, prompt hardening, policy enforcement, error handling).
- Implement secure tool execution (least privilege, allowlists, secrets management, audit logging; prevent prompt injection/data exfiltration).
- Provide agent observability (traces, tool-call telemetry, cost/latency budgets, SLO-based alerting).
- Design/evaluate agents (evaluation sets, adversarial/regression tests, drift monitoring).
- Build RAG/retrieval pipelines with vector DBs (Chroma, Milvus, Weaviate, Qdrant).
- Collaborate with cross-functional SMEs; maintain AI system documentation (ADRs, runbooks, API specs, diagrams).
- Containerized deployment/commissioning/release qualification (Docker, multi-stage builds, health checks).
- Monitor performance, collect metrics/logs, and propose optimizations; follow SOPs and templates.
Education & Experience (Required/Preferred)
- Bachelor’s in CS/Software Eng (or related) + 3+ years relevant experience (required).
- 2+ years Python (3.12+) (required).
- 2+ years TypeScript (required).
- AI agent framework experience in production/near-production (LangGraph/LangChain/CrewAI/LlamaIndex) (required).
- Docker/containerized apps + multi-stage builds/DevOps fundamentals (required).
- Preferred: enterprise/reg, troubleshooting/optimization; formal change control/compliance/audit.
Skills & Abilities (Required/Preferred)
- Cross-functional teamwork; strong technical writing and communication.
- Secure, production-grade AI services/infrastructure; agent orchestration and context management.
- Data analytics/observability (metrics/logging/tracing/dashboards).
- API design, error handling, backend security; AI safety/guardrail patterns.
Application Instructions
- Application window anticipated to close in 60 days from posting (or sooner if filled/closed).
The Software Engineer – AI is a hands-on role integrating data engineering, software development, and AI agent architecture, working with platform engineering, data science, security, and product teams to implement production-grade AI systems.
Essential Functions
- Design, develop, maintain, and deploy AI agent systems (LangGraph StateGraph patterns, CrewAI, LlamaIndex, or related frameworks).
- Build FastAPI-based agent servers (async/await, streaming, health checks).
- Implement testing (unit, integration, edge-case, performance) for production reliability.
- Implement AI guardrails (input/output validation, safety checks, prompt hardening, policy enforcement, error handling).
- Implement secure tool execution (least privilege, allowlists, secrets management, audit logging; prevent prompt injection/data exfiltration).
- Provide agent observability (traces, tool-call telemetry, cost/latency budgets, SLO-based alerting).
- Design/evaluate agents (evaluation sets, adversarial/regression tests, drift monitoring).
- Build RAG/retrieval pipelines with vector DBs (Chroma, Milvus, Weaviate, Qdrant).
- Collaborate with cross-functional SMEs; maintain AI system documentation (ADRs, runbooks, API specs, diagrams).
- Containerized deployment/commissioning/release qualification (Docker, multi-stage builds, health checks).
- Monitor performance, collect metrics/logs, and propose optimizations; follow SOPs and templates.
Education & Experience (Required/Preferred)
- Bachelor’s in CS/Software Eng (or related) + 3+ years relevant experience (required).
- 2+ years Python (3.12+) (required).
- 2+ years TypeScript (required).
- AI agent framework experience in production/near-production (LangGraph/LangChain/CrewAI/LlamaIndex) (required).
- Docker/containerized apps + multi-stage builds/DevOps fundamentals (required).
- Preferred: enterprise/reg, troubleshooting/optimization; formal change control/compliance/audit.
Skills & Abilities (Required/Preferred)
- Cross-functional teamwork; strong technical writing and communication.
- Secure, production-grade AI services/infrastructure; agent orchestration and context management.
- Data analytics/observability (metrics/logging/tracing/dashboards).
- API design, error handling, backend security; AI safety/guardrail patterns.
Application Instructions
- Application window anticipated to close in 60 days from posting (or sooner if filled/closed).