AI Work Central
For you AlertsAlerts
WeekdayOpen · Source checked

Subject Matter Experts: ML Model Evaluation (PhD)

$150/hr

Listed rate, USDFull-timeCodingUS + 5 countries

Free: we never charge you to search or apply. The button opens this role on Weekday's own site.

Get roles that fit you by email. Free.

Email me roles that fit

Other open Coding roles

Each is open in at least one country this role lists. Newest first. See the full list

Can I apply from my country?

6 countries

  • Canada
  • Iceland
  • Norway
  • Switzerland
  • United Kingdom
  • United States

Key details

Location
Remote, in the countries above
Contract type
Full-time
Language
English
Field
Coding
  1. Posted and first seen
  2. Last checked

Listed on Weekday since 13 Nov, last checked 15 Nov.

Weekday posts this role for a client and does not say which company it is.

Entry: open · 89 roles today · checked 15 November 2026

In plain words

What you will do
Review machine learning model outputs generated in response to a range of research-focused and domain-specific prompts. from the Weekday listing
Who can apply
The listing is open to people in Canada, Iceland, Norway, Switzerland, United Kingdom and United States.
Pay and time
$150/hr as listed, full-time work, remote.

What you'll do

This role is for one of Weekday’s clients

Engagement Type: Independent Contractor

Work Arrangement: Fully Remote

Estimated Commitment: Approximately 5 Hours

Schedule: Flexible, Asynchronous

Payment Frequency: Weekly, based on services rendered

Eligibility:

  • Applicants must be from any of these geographies : US, UK, Canada, the EU, Norway, Switzerland and Iceland.
  • Should have a finished / running paper in any of these topics : NeurIPS, ICML, ICLR, COLM or RLC
  • We are unable to support H1-B or STEM OPT candidates at this time.

Note:

  • Pay : $150 / hr
  • This requirement is super-urgent & would be awesome if you can start on the project within Friday EOD.

Role Overview

We are seeking highly qualified Subject Matter Experts with PhD-level academic or professional expertise across specialised research and professional domains to participate in a paid Machine Learning (ML) Model Evaluation project.

The project focuses on assessing the quality, accuracy, and reliability of AI-generated responses to complex research prompts and domain-specific questions. Your evaluations will help identify where current machine learning models perform effectively and where their outputs require further refinement.

This opportunity is suited to experienced researchers, academics, data analysts, technical writers, and domain specialists who can critically assess complex information, identify factual inaccuracies, and provide structured, evidence-based feedback.

Requirements

Key Responsibilities

  1. Review machine learning model outputs generated in response to a range of research-focused and domain-specific prompts.
  2. Evaluate AI-generated responses for factual accuracy, relevance, completeness, and overall quality.
  3. Assess the technical validity and reliability of information presented in model-generated responses.
  4. Use a structured rating system to evaluate and score responses consistently.
  5. Provide concise, clear, and well-reasoned written justifications supporting evaluation scores.
  6. Identify factual errors, gaps in reasoning, irrelevant information, and areas requiring improvement.
  7. Complete approximately five hours of independent evaluation work asynchronously.
  8. Maintain consistency and attention to detail throughout the evaluation process.

Required Qualifications and Skills

  1. PhD or equivalent advanced subject matter expertise in a relevant academic, technical, or professional discipline.
  2. Strong academic or professional background in a specialised domain, with the ability to assess complex information critically.
  3. Excellent analytical, research, and critical-thinking skills.
  4. Ability to evaluate technical content, research findings, and domain-specific information for factual correctness and relevance.
  5. Strong written communication skills, particularly in providing clear and structured evaluation justifications.
  6. High attention to detail and the ability to identify subtle inaccuracies, inconsistencies, and gaps in AI-generated responses.
  7. Ability to work independently and complete approximately five hours of asynchronous evaluation tasks.

Suitable Candidate Profiles

Professionals from the following backgrounds are encouraged to apply:

  • Academic researchers and university faculty
  • PhD scholars and doctoral-level subject matter experts
  • Data analysts and research analysts
  • Technical writers and research professionals
  • Domain specialists with experience evaluating technical or research-focused content

Engagement and Payment Terms

  • Contract Type: Independent contractor engagement.
  • Work Arrangement: Fully remote, with flexible working hours.
  • Project Duration: Approximately five hours of evaluation work.
  • Payment: Payments are processed weekly based on services rendered.
  • Project Continuity: The engagement may be extended, shortened, or concluded early depending on project requirements and individual performance.
  • Confidentiality: Participation will not require access to confidential or proprietary information belonging to any current or former employer, client, or academic institution.
  • Work Authorisation: H-1B and STEM OPT candidates cannot be supported for this opportunity.

Interview and Evaluation Expectations

During the interview process, candidates may be assessed on their review practices, critical thinking, and ability to improve the quality of their evaluations. Responses should address the following three habits:

  1. Exchanging unfinished review notes with another reviewer.
  2. Maintaining a separate log of opinions or assessments that have changed during the review process.
  3. Using review notes and feedback to update personal reading lists.

Ideal Candidate Profile

The ideal candidate combines deep subject matter expertise with strong research judgement and analytical precision. They should be comfortable reviewing complex AI-generated content, distinguishing accurate information from flawed reasoning, and communicating their assessments through clear, structured feedback.

From the Weekday listing, as published.

How to apply

Software Engineering and Coding interview questions · STEM and Research Reasoning interview questions

Pay

Listed by Weekday, in USD. Is Weekday legit?

This role All Coding

On a ruler from $0 to $150 an hour: $150.

Compared with 149 Coding roles with an hourly rate: the median is $70 and half sit between $60 and $95. Midpoint of each listed range, 15 Nov.

This is the rate Weekday lists for the role. Weekday sets the final rate, which can differ from the listed range. Estimate a week at this rate

How this role compares

At $150 an hour (its listed rate), this role is $55 above the median Weekday role, $95 from 71 roles with an hourly rate and $80 above the median Coding role on all platforms, $70 from 149 roles. The medians are the count of our Pay Index on 15 November 2026, with each role counted once.

Entry at Weekday is open: its own job list had open roles when we read it on 15 November 2026.

Similar open roles: Ground Combat & Special Operations SME at micro1, $75 to $130/hr; Junior Machine Learning Engineer at micro1, $60 to $120/hr; Game Developer (Godot Expert) at Weekday, $70 to $130/hr.

Sign in or create an account

No password. The first time, this creates your account.

Continue with Google

Your account emails you up to 5 roles a week that fit your country and field. Don't send me emails

By creating an account you confirm you are 18 or over and accept the terms of use and the privacy notice. Who we are: legal notice.

Settings

Loading your settings