Sr. Technical Analyst, Agentic AI
Johnson & Johnson
August 25, 2026
On-site
Raritan, NJ
IT
Responsibilities:
- Own product backlog/roadmap for agentic document-generation solutions; draft technical/regulatory/compliance documents from source evidence.
- Build and refine prompt templates, agent workflows, and orchestration logic for multi-step reasoning with section-level traceability.
- Define acceptance criteria for consistent, citation-accurate, traceable outputs for human review.
- Own product backlog for agentic cognitive-search: intent understanding, cited synthesis answers, modular retrieval/search, and role-based access governance.
- Lead end-to-end delivery (sprint planning, release readiness, go/no-go), translate requirements into user stories/specs/acceptance criteria, manage dependencies, change impact, and risk.
- Monitor quality; define feedback loops/guardrails; support incident/problem management (orchestration, LLM performance, retrieval accuracy, hallucinations).
- Ensure compliance/regulatory adherence and maintain audit-ready traceability; support responsible AI (bias monitoring, content safety).
Qualifications:
- 5–8+ years in product/business analysis in technology, Life Sciences, or regulated environments.
- Demonstrable expertise designing/deploying/managing multi-step autonomous agentic AI workflows.
- Hands-on LLMs, RAG pipelines, prompt engineering, and at least one agentic framework (LangGraph, CrewAI, AutoGen, or equivalent).
- Strong semantic search/vector/retrieval understanding; ability to translate AI/ML to requirements/user stories/acceptance criteria.
- Experience with AI evaluation/quality metrics (hallucination rate, citation accuracy, retrieval precision/recall).
Preferred:
- Document-generation/IDP experience; PLM/ECM/regulatory workflows.
- AWS (Bedrock, SageMaker, Step Functions, Agentcore) or similar cloud AI platforms.
- Responsible AI/model governance knowledge; AI/ML certification/training.
Benefits (subject to plan terms): medical/dental/vision, life insurance, short-/long-term disability, retirement plan and 401(k), and time-off (vacation, sick time, holidays, parental leave, etc.).
- Own product backlog/roadmap for agentic document-generation solutions; draft technical/regulatory/compliance documents from source evidence.
- Build and refine prompt templates, agent workflows, and orchestration logic for multi-step reasoning with section-level traceability.
- Define acceptance criteria for consistent, citation-accurate, traceable outputs for human review.
- Own product backlog for agentic cognitive-search: intent understanding, cited synthesis answers, modular retrieval/search, and role-based access governance.
- Lead end-to-end delivery (sprint planning, release readiness, go/no-go), translate requirements into user stories/specs/acceptance criteria, manage dependencies, change impact, and risk.
- Monitor quality; define feedback loops/guardrails; support incident/problem management (orchestration, LLM performance, retrieval accuracy, hallucinations).
- Ensure compliance/regulatory adherence and maintain audit-ready traceability; support responsible AI (bias monitoring, content safety).
Qualifications:
- 5–8+ years in product/business analysis in technology, Life Sciences, or regulated environments.
- Demonstrable expertise designing/deploying/managing multi-step autonomous agentic AI workflows.
- Hands-on LLMs, RAG pipelines, prompt engineering, and at least one agentic framework (LangGraph, CrewAI, AutoGen, or equivalent).
- Strong semantic search/vector/retrieval understanding; ability to translate AI/ML to requirements/user stories/acceptance criteria.
- Experience with AI evaluation/quality metrics (hallucination rate, citation accuracy, retrieval precision/recall).
Preferred:
- Document-generation/IDP experience; PLM/ECM/regulatory workflows.
- AWS (Bedrock, SageMaker, Step Functions, Agentcore) or similar cloud AI platforms.
- Responsible AI/model governance knowledge; AI/ML certification/training.
Benefits (subject to plan terms): medical/dental/vision, life insurance, short-/long-term disability, retirement plan and 401(k), and time-off (vacation, sick time, holidays, parental leave, etc.).