Help shape the future of AI by designing realistic healthcare and medical tasks that challenge advanced AI agents.
Location: Remote
Type: Contract / Part-time
Commitment: 20 hours/week
Compensation: US$30–60/hour
Project duration: 2 months, with potential extension
Availability: Immediate start
At Anyone AI, we create high-quality training and evaluation data for frontier AI models. We're looking for Healthcare and Medical Experts, including physicians, radiologists, clinical researchers, epidemiologists, and healthcare informatics specialists, with practical experience in clinical analysis, medical documentation, healthcare data, or medical research.
You'll develop and validate realistic tasks that assess whether AI agents can interpret medical information, analyze healthcare datasets, identify inconsistencies, synthesize clinical evidence, and complete professional healthcare workflows.
We're interested in experts across multiple medical specialties. Candidates are expected to demonstrate deep expertise in at least one relevant area rather than across every medical discipline.
Your expertise will help establish reliable reference solutions and meaningful evaluation criteria.
Design realistic medical and healthcare tasks based on clinical, research, epidemiological, or healthcare administration workflows.
Develop tasks involving medical record interpretation, clinical documentation review, and healthcare data analysis.
Analyze clinical research findings, medical literature, and evidence-based guidelines.
Prepare and validate calculations involving epidemiological metrics, clinical statistics, or healthcare outcomes.
Develop tasks involving diagnostic documentation, medical coding, imaging reports, or clinical research protocols, depending on your specialization.
Identify inconsistencies, missing information, unsupported conclusions, and errors in medical documentation.
Create reference solutions supported by scientific evidence, documented assumptions, and reliable sources.
Review AI-generated medical analyses and reports for accuracy, completeness, and appropriate interpretation.
Collaborate with technical contributors to define reproducible tasks and objective evaluation criteria.
Work with appropriately de-identified or synthetic data, following relevant privacy and confidentiality requirements.
A medical degree, a bachelor's degree or higher in a relevant health sciences discipline, or equivalent specialized professional qualifications.
Substantial professional experience in at least one of the following areas: clinical medicine, radiology, epidemiology, clinical research, public health, or healthcare informatics.
Strong understanding of medical terminology, healthcare documentation, and evidence-based decision-making within your specialty.
Ability to interpret clinical records, research documentation, medical datasets, or diagnostic reports.
Experience analyzing healthcare information and identifying discrepancies or unsupported conclusions.
Familiarity with relevant clinical, scientific, or healthcare quality standards.
Strong analytical reasoning and attention to detail.
Ability to communicate complex medical or scientific concepts clearly.
Strong written English communication skills.
An MD, Master's, PhD, or relevant professional certification in a medical or healthcare discipline.
Clinical specialization, professional medical licensure, or board certification.
Experience with clinical trials, systematic reviews, or healthcare research.
Familiarity with medical imaging, DICOM, electronic health records, or healthcare interoperability standards.
Experience with medical statistics, Python, R, or healthcare data analysis tools.
Previous experience reviewing AI-generated medical content, clinical AI applications, or medical evaluation benchmarks.