General Clinician (MD/DO) – Clinical AI Evaluation

$312,000/year annualized
$150/hour
Remote | Hourly Contract | Worldwide

Annualized compensation is based on 40 hours per week × 52 weeks. Actual earnings depend on hours worked, project availability, and engagement requirements.

About the Opportunity

We are seeking residency-trained physicians across specialties to contribute clinical expertise to the development and evaluation of advanced AI systems.

This is a non-clinical role focused on applying physician-level judgment to clinical AI evaluation, structured annotation, grading-criteria development, and challenging medical reasoning tasks. There is no direct patient care and no responsibility for live diagnosis.

You’ll join a shared expert pool and may be matched with different clinical workstreams based on your specialty, availability, and project needs.

What You’ll Do

Depending on the assigned workstream, your responsibilities may include:

• Develop grading criteria that break clinical questions and ideal answers into clear, objective, checkable standards.

• Evaluate clinical dialogues for accuracy, safety, completeness, appropriate uncertainty, and escalation guidance.

• Annotate clinical reasoning, including relevant differentials, reasoning pathways, and why particular conclusions are supported or rejected.

• Review AI outputs for hallucinated findings, dangerous omissions, unsupported certainty, and clinically unsafe recommendations.

• Develop specialty guidelines covering standards of care, edge cases, and evaluation criteria.

• Create difficult clinical questions and scenarios designed to test the limits of current AI reasoning.

• Provide structured written feedback that can be understood and applied consistently by broader evaluation teams.

Workstream assignments may range from shorter dialogue reviews to longer grading-criteria development and clinical reasoning tasks. Specific throughput expectations will depend on the project.

Who Should Apply

This opportunity is designed for physicians who can translate real-world clinical judgment into structured, evidence-based evaluation criteria.

Required Qualifications

• MD or DO with completed residency training in any specialty.

• Active, unrestricted medical license in your country of practice.

• 2+ years of post-residency clinical experience, whether currently practicing or previously practicing.

• Strong ability to write structured clinical rationale clearly and logically.

• Fluency in written and spoken English.

• Ability to commit at least 20 hours per week, with flexibility to concentrate hours when projects are time-sensitive.

Preferred Qualifications

• Board certification in your specialty.

• U.S. medical licensure and familiarity with U.S. clinical guidelines and standards of care.

• Background in primary care, internal medicine, emergency medicine, hospital medicine, or another specialty involving broad clinical presentations.

• Experience with clinical annotation, medical education, AI evaluation, medical question writing, or related work.

• Experience developing grading criteria, assessing residents, or contributing to clinical guidelines.

• Published research or sustained technical writing experience, with a sample available if requested.

Work Arrangement

• Fully remote and worldwide.

• Independent contractor engagement.

• Flexible scheduling, subject to project requirements.

• Minimum commitment of 20 hours per week.

• Workstreams may be extended, shortened, or concluded as project needs change.

• Projects are non-clinical and do not involve direct patient care.

• Work should not involve confidential or proprietary information belonging to an employer, client, or institution.

• Payments are made weekly through Stripe or Wise based on services rendered.

• H-1B and STEM OPT candidates are not supported for this opportunity.