Senior Manager, Intelligence Systems Lab
Bristol Myers Squibb
6 months ago
Remote friendly (Seattle, WA)
United States
IT
Description:
Senior Manager of Intelligence Systems Lab (enterprise AI strategy). Conduct research and build agentic AI systems using rigorous evaluation science, focusing on reasoning, planning, memory, and generalization for AI agents; develop benchmarking methodologies. Supports cross-functional stakeholders across Commercial, Manufacturing, Clinical Development, and Research.
Responsibilities:
- Research and framework development for reasoning, planning, memory, and generalization; agent cognition frameworks (abstraction, goal decomposition, adaptive planning).
- Design and execute benchmarking/evaluation experiments; create evaluation methodologies, test harnesses, datasets, and measurement frameworks; apply experimental design and statistical analysis.
- Hands-on agentic AI engineering: develop/deploy multi-agent systems (e.g., Strands, LangGraph, DSPy) and autonomous workflows.
- Build RAG applications, knowledge graphs, and conversational AI solutions.
- Prototype/POCs; translate research into production-ready capabilities; document findings.
- Cross-functional collaboration and mentorship/best practices in evaluation and research methodology.
Qualifications (Required/Preferred):
- Education: BA/BS required (quantitative field). MS preferred.
- Skills: Python (R or Julia), ML frameworks (Scikit-Learn/TensorFlow/PyTorch), agentic frameworks (Strands/LangGraph/AutoGen/DSPy/CrewAI), LLMs/prompt engineering/RAG, SQL, cloud (AWS/Azure/GCP), Git; experimental design & statistical analysis preferred.
- Experience: 3+ years in data science/ML/AI development or research; pharma/life sciences preferred.
- Communication: ability to explain complex research to technical and non-technical audiences.
Benefits (explicitly listed):
- Health coverage (medical/pharmacy/dental/vision), wellbeing support, 401(k), disability, life insurance, and paid time off (flexible time off and paid holidays; additional time-off eligibility).
Application instructions:
- Apply even if you don’t perfectly match requirements.
Senior Manager of Intelligence Systems Lab (enterprise AI strategy). Conduct research and build agentic AI systems using rigorous evaluation science, focusing on reasoning, planning, memory, and generalization for AI agents; develop benchmarking methodologies. Supports cross-functional stakeholders across Commercial, Manufacturing, Clinical Development, and Research.
Responsibilities:
- Research and framework development for reasoning, planning, memory, and generalization; agent cognition frameworks (abstraction, goal decomposition, adaptive planning).
- Design and execute benchmarking/evaluation experiments; create evaluation methodologies, test harnesses, datasets, and measurement frameworks; apply experimental design and statistical analysis.
- Hands-on agentic AI engineering: develop/deploy multi-agent systems (e.g., Strands, LangGraph, DSPy) and autonomous workflows.
- Build RAG applications, knowledge graphs, and conversational AI solutions.
- Prototype/POCs; translate research into production-ready capabilities; document findings.
- Cross-functional collaboration and mentorship/best practices in evaluation and research methodology.
Qualifications (Required/Preferred):
- Education: BA/BS required (quantitative field). MS preferred.
- Skills: Python (R or Julia), ML frameworks (Scikit-Learn/TensorFlow/PyTorch), agentic frameworks (Strands/LangGraph/AutoGen/DSPy/CrewAI), LLMs/prompt engineering/RAG, SQL, cloud (AWS/Azure/GCP), Git; experimental design & statistical analysis preferred.
- Experience: 3+ years in data science/ML/AI development or research; pharma/life sciences preferred.
- Communication: ability to explain complex research to technical and non-technical audiences.
Benefits (explicitly listed):
- Health coverage (medical/pharmacy/dental/vision), wellbeing support, 401(k), disability, life insurance, and paid time off (flexible time off and paid holidays; additional time-off eligibility).
Application instructions:
- Apply even if you don’t perfectly match requirements.