AI Work Central
Get alerts

AI Agent Evaluator

micro1GeneralistNew

$25 to $45/hr as listed by micro1, USDEstimate a week at this rate
Apply on micro1

Referral link: we may earn a bonus if you're hired. Costs you nothing. Disclosure

micro1 lists a $100 referral reward for this role. The button above is a referral link: if you are hired and complete your first paid hours, micro1 may pay that amount to this site. Your pay is not affected. Opens micro1 in a new tab. This site is not the employer and does not handle applications. How referrals work

Where
58 countries

Bangladesh, Hong Kong, India, Indonesia, Japan, Kazakhstan, Kyrgyzstan, Malaysia, Pakistan, Philippines, Singapore, Sri Lanka, Taiwan, Thailand, Uzbekistan, Vietnam, Austria, Belarus, Belgium, Denmark, France, Germany, Greece, Italy, Netherlands, Portugal, Russia, Spain, Switzerland, United Kingdom, Argentina, Brazil, Chile, Colombia, Mexico, Peru, Algeria, Bahrain, Egypt, Iraq, Jordan, Kuwait, Lebanon, Libya, Morocco, Oman, Palestine, Qatar, Saudi Arabia, Tunisia, United Arab Emirates, United States, Canada, Nigeria, Kenya, South Africa, Ghana, Ethiopia

Language
English
Type
Contract, remote

Posted on micro1 First seen 10 Oct 2026Checked 12 Oct 2026Listed until 8 Dec 2026

From the micro1 listing

Role Title: AI Agent Evaluator

Role Type: Contractor

Location: U.S based

Opportunity Snapshot

Pay: $25-45/hour

Time per task: ~1.5 hours per run (evidence and scoring included)

Project kickoff: Monday, October 12

Onboarding: Today (Fri), Saturday, or Sunday, so you’re ready to start Monday October 10th

You’ll need: An active personal popular AI account (Free, Go, or Plus; not Pro), an active personal and a smartphone that can screen record

Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results

About the role

AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you.

You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.

What you’ll do

  1. Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
  2. Approve or stop the agent at key steps
  3. Screen record every attempt
  4. Score each run on completion, quality, control issues, satisfaction, and time
  5. Share clear written feedback on the agent experience

Who we’re looking for

  1. US-based, with a Bachelor’s degree
  2. Someone who already uses AI in daily life
  3. 2-3 years of experience, preferably in engineering, business management, or office/operations
  4. Detail-oriented, great at following instructions and documenting each step
  5. Clear written communication
  6. Generalists welcome, domain experts preferred
  7. No coding or AI background needed

Why you’ll like it

  1. Get paid to use the AI tools you already use
  2. Work entirely from your phone, on your schedule
  3. Have a direct say in how next-generation AI agents get built and improved

How the selection process works

  1. Apply
  2. Complete the screening questions
  3. Interview: 15-30 minutes max
  4. Profile review: if everything looks good, we present you to the client
  5. Onboarding: our Talent Ops team will contact you to get you started

Text above is the platform's own listing, shown as published. Check the details on micro1 before applying.

Prepare for the assessment

Practice questions and what each platform says about its screening for this kind of role:

Terms in this listing

  • Domain expert: Someone hired for professional knowledge in a field, such as law, medicine or engineering, to write or judge expert-level tasks.

How applying on micro1 works

You apply from the role page on micro1. A third-party job page describes an interview run by an AI interviewer (aitrainer.work), and micro1's referral program page says referred candidates must complete certification (referral program page). The exact steps differ by role and were not verified first-hand for this page.

Full micro1 review

More roles like this

5 of the 117 open Generalist roles, micro1 first. Pay is what each platform lists. All 117 Generalist roles

$245 to $280/hr Management Consultant GeneralistRemote, 58 countriesContract micro1Referral link $150 to $350/hr Consulting Specialist GeneralistUnited States, United KingdomContract micro1Referral link $150 to $350/hr Brand & Creative Strategy Expert GeneralistRemote, 58 countriesContract micro1Referral link $60 to $100/hr Shopify Specialist GeneralistRemote, 58 countriesContract micro1Referral link $50 to $100/hr Revenue Operations Specialist (SaaS) GeneralistRemote, 58 countriesContract micro1Referral link

Referral link: we may earn a bonus if you're hired. Costs you nothing.

All 117 Generalist rolesAll 266 micro1 roles
$25 to $45/hrReferral linkApply on micro1