Senior Specialist, Full Stack Developer, Regulatory Engineering & Operations
Bristol Myers Squibb
4 hours ago
Remote friendly (Madison, NJ)
United States
IT
Position Summary
- Full Stack Developer for an AI-first, Agile product team supporting Global Regulatory Sciences (GRS).
- Develop and operate AI-native regulatory products using large language models and agentic workflows to solve business problems.
Key Responsibilities
- Rapidly prototype AI solutions, validate hypotheses with users and data, and iterate from proof-of-concept to MVP and production-ready releases with measurable outcomes.
- Develop and maintain LLM-powered and agentic applications as long-lived products, including human-in-the-loop review, controlled model updates, monitoring/observability, and governance (evaluation, auditability, access controls). Experience with OpenAI, AWS Bedrock, LangChain.
- Build scalable, reliable, secure applications using Python and/or Java and modern front-end frameworks (e.g., React).
- Design and operate secure document ingestion + vectorization workflows on AWS (S3, event-driven processing) for governed retrieval across structured/unstructured Regulatory Affairs content (Amazon S3 Vectors and/or OpenSearch).
- Design and implement microservices and APIs on AWS using event-driven architectures and asynchronous processing.
- Implement CI/CD pipelines and infrastructure-as-code for repeatable, compliant deployments.
- Monitor model performance in production; manage drift detection, evaluation, retraining/refresh, and rollback strategies.
- Investigate issues across systems and data; deliver short-term fixes and long-term architectural improvements.
Qualifications & Experience
- Growth mindset; ability to rapidly prototype, gather feedback, and evolve POCs into MVPs and production-ready solutions in ambiguity.
- Minimum 2 years of software development experience; Pharma/Life Sciences experience is a plus.
- Bachelor’s degree in Computer Science, Software Engineering, or related field.
Required/Preferred Skills
- Strong proficiency in Python and/or Java and a UI framework (preferably React).
- Solid understanding of AI concepts; familiarity developing AI applications.
- Generative/agentic AI experience with tools like Claude, OpenAI, LangChain (plus).
- AWS Cloud services (Lambda, S3, DynamoDB, Bedrock, SageMaker) (plus).
- Experience with document ingestion/vectorization pipelines for RAG/search (parsing, cleaning, chunking, metadata enrichment, embeddings).
- Familiarity with vector storage/retrieval (Amazon S3 Vectors, OpenSearch vector search, pgvector, or other vector DBs) including indexing/relevance tuning.
- Excellent data analytics skills (SQL/NoSQL; efficient query writing).
- Strong problem-solving and analytical skills; relationship building and effective collaboration/communication in a matrix organization.
Benefits (as stated)
- Health Coverage: medical, pharmacy, dental, vision.
- Wellbeing support programs (including EAP).
- Financial well-being/protection (401(k), disability, life insurance, etc.).
- Paid Time Off (including flexible time off and paid national holidays; varies by location/employee type).
Application instructions
- None provided in the job-description content.
- Full Stack Developer for an AI-first, Agile product team supporting Global Regulatory Sciences (GRS).
- Develop and operate AI-native regulatory products using large language models and agentic workflows to solve business problems.
Key Responsibilities
- Rapidly prototype AI solutions, validate hypotheses with users and data, and iterate from proof-of-concept to MVP and production-ready releases with measurable outcomes.
- Develop and maintain LLM-powered and agentic applications as long-lived products, including human-in-the-loop review, controlled model updates, monitoring/observability, and governance (evaluation, auditability, access controls). Experience with OpenAI, AWS Bedrock, LangChain.
- Build scalable, reliable, secure applications using Python and/or Java and modern front-end frameworks (e.g., React).
- Design and operate secure document ingestion + vectorization workflows on AWS (S3, event-driven processing) for governed retrieval across structured/unstructured Regulatory Affairs content (Amazon S3 Vectors and/or OpenSearch).
- Design and implement microservices and APIs on AWS using event-driven architectures and asynchronous processing.
- Implement CI/CD pipelines and infrastructure-as-code for repeatable, compliant deployments.
- Monitor model performance in production; manage drift detection, evaluation, retraining/refresh, and rollback strategies.
- Investigate issues across systems and data; deliver short-term fixes and long-term architectural improvements.
Qualifications & Experience
- Growth mindset; ability to rapidly prototype, gather feedback, and evolve POCs into MVPs and production-ready solutions in ambiguity.
- Minimum 2 years of software development experience; Pharma/Life Sciences experience is a plus.
- Bachelor’s degree in Computer Science, Software Engineering, or related field.
Required/Preferred Skills
- Strong proficiency in Python and/or Java and a UI framework (preferably React).
- Solid understanding of AI concepts; familiarity developing AI applications.
- Generative/agentic AI experience with tools like Claude, OpenAI, LangChain (plus).
- AWS Cloud services (Lambda, S3, DynamoDB, Bedrock, SageMaker) (plus).
- Experience with document ingestion/vectorization pipelines for RAG/search (parsing, cleaning, chunking, metadata enrichment, embeddings).
- Familiarity with vector storage/retrieval (Amazon S3 Vectors, OpenSearch vector search, pgvector, or other vector DBs) including indexing/relevance tuning.
- Excellent data analytics skills (SQL/NoSQL; efficient query writing).
- Strong problem-solving and analytical skills; relationship building and effective collaboration/communication in a matrix organization.
Benefits (as stated)
- Health Coverage: medical, pharmacy, dental, vision.
- Wellbeing support programs (including EAP).
- Financial well-being/protection (401(k), disability, life insurance, etc.).
- Paid Time Off (including flexible time off and paid national holidays; varies by location/employee type).
Application instructions
- None provided in the job-description content.