FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Post Doctoral Researcher, Evaluation & Standards – Clinical Operations
Johnson & JohnsonPostdoctoral Researcher developing evaluation frameworks for generative AI in clinical operations, working with J&J's Generative AI Teams and regulatory subject matter experts.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing evaluation frameworks and rubrics for AI in clinical operations, with a strong understanding of quality dimensions and workflows in clinical data management and regulatory documentation. Proficient in Python and modern AI tooling, with the ability to collaborate across disciplines to enhance AI applications in regulated environments.
Highest-signal resume keywords
Clinical Operations ExpertiseEvaluation Framework DevelopmentPython ProgrammingGenerative AI PrototypingQuality Assessment Methodology
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Evaluation FrameworksClinical Data ManagementRegulatory DocumentationAnomaly DetectionBenchmark Dataset CreationQuality Dimensions DefinitionHuman Evaluation ProtocolsStructured Assessment ProtocolsData AnalysisMachine Learning
Soft Skills
Analytical SkillsWriting SkillsCuriosityComfort with AmbiguityInterdisciplinary Collaboration
Tools & Technologies
LLM APIsVector DatabasesEvaluation FrameworksAI Engineering ToolsData Science Tools
Certifications & Qualifications
PhD in Clinical, Biomedical, Regulatory, or Biostatistics Field
Industry Keywords
Clinical OperationsGlobal DevelopmentRegulatory AffairsAI ApplicationsQuality AssessmentClinical TrialsSite OperationsExpert RatersInter-Rater ReliabilityClinical Data Queries
Tech Stack
Tools & technologiesPython
About the role
Key responsibilities & impact- Develop evaluation frameworks and rubrics for AI agents operating in clinical operations and global development contexts
- Define quality dimensions for specialized outputs, e.g. clinical data queries, anomaly detection, protocol Q&A responses, ICF content, regulatory documents, that reflect how clinical-ops users actually judge quality
- Design and run human evaluation protocols with clinical, regulatory, and site-facing subject matter experts
- Build benchmark datasets and evaluation pipelines that the broader GenAI organization uses across AI applications
- Partner with our AI engineering teams to translate evaluation findings into measurable improvement
- Contribute to the methodology of how a regulated pharma organization evaluates AI in clinical work
Requirements
What you’ll need- Strong understanding of clinical operations and global development workflows, e.g. clinical data management, monitoring, regulatory documentation, site operations, or related areas
- Familiarity with how clinical-ops specialists, monitors, regulatory authors, and site teams actually do their work and assess quality
- PhD or equivalent research experience in a clinical, biomedical, regulatory, biostatistics, or closely related field
- Genuine interest in working hands-on with generative AI and agentic systems
- Curiosity about how LLMs behave in specialized domains and where they fail
- Comfort prototyping with modern AI tooling (LLM APIs, vector databases, evaluation frameworks)
- Demonstrated ability to develop frameworks, rubrics, and structured assessment protocols
- Experience designing evaluations with multiple quality dimensions, expert raters, or non-trivial inter-rater reliability considerations
- Strong analytical and writing skills; comfort with ambiguity and unsolved problems
- Practical skills Python and the modern ML/data stack
- Comfort working across disciplines, e.g. clinical operations, regulatory affairs, AI engineering, data science
Benefits
Comp & perks- an annual bonus with set target (% of pay) depending on pay grade / location, where the actual amount is based on the employees’ and companies’ performance of the previous calendar year, or sales commissions.
- vacation days
- parental leave for a minimum of 12 weeks
- bereavement leave
- caregiver leave
- volunteer leave
- well-being reimbursement
- programs for financial, physical and mental health.
- service anniversary and recognition awards
- can participate in several insurance plans.