r/AIEvaluators

I made a website that aims to make the AI Training/Annotating Job search easier
▲ 22 r/AIEvaluators+11 crossposts

I made a website that aims to make the AI Training/Annotating Job search easier

Hello, I have gotten really annoyed by constantly getting rejected after literally spending hours applying, doing assessments, and verifying my identity and then getting rejected or not even hearing back. I therefore decided to make my own site where I try to make the job search easier by listing job offers from multiple companies, listing jobs with a relatively high hiring volume, and having a lot of guides where I give tips on how to pass assessments.

No sign-up or anything like that required. The listings include entry-level jobs but also expert positions (software engineer, PhD, etc.). Let me know what you think and if there is anything that I can improve or implement. Here is the link to the website: aiannotationjobs.com

u/AIWORK1233 — 4 days ago
▲ 97 r/AIEvaluators+1 crossposts

My honest experience working with Mercor for 4+ months: The good, the bad, and the reality

I joined Mercor in June 2026 and worked on an AI evaluation project for over four months before being offboarded in September. Here's my honest experience for anyone considering joining.

What I worked on: Evaluating AI-generated content, assessing accuracy and reasoning, applying detailed rubrics, and providing feedback. I was also promoted to Reviewer for a period, which involved reviewing other evaluators' work.

✅ Pros

- Excellent earning potential: My project displayed a rate of $XX/hour, which is exceptional compared with many conventional remote opportunities.

- Interesting work: You get to apply real professional expertise to AI development rather than doing generic data-entry tasks.

- Career progression: I progressed from Evaluator to Reviewer, gaining experience in quality control and calibration.

- Remote flexibility: The work can be done remotely, without a conventional office environment.

- Exposure to AI: A valuable opportunity to understand how AI systems are evaluated and improved.

❌ Cons

- Job security is practically nonexistent: Even after months of work, project pauses, reassignment, or offboarding can happen.

- Inconsistent availability: A good project and attractive hourly rate mean little if work isn't consistently available.

- Uncertainty: You cannot necessarily predict how long a project will last or what happens when it ends.

- Performance pressure: Detailed rubrics, quality expectations, and time tracking can make the work demanding.

- Not a conventional job: Don't assume a project offer means stable, long-term employment.

My final verdict

Mercor gave me valuable experience, good earning potential, and the opportunity to progress into reviewing. However, being offboarded after more than four months was a reminder that a high hourly rate doesn't equal job security.

My advice? Give it a try if you qualify, do quality work, and make the most of the opportunity. Keep Applying.

For those currently working with Mercor: Has your experience been consistent, or have you also experienced project pauses, reassignment, or unexpected offboarding?

u/HashK204 — 5 days ago
▲ 56 r/AIEvaluators+1 crossposts

Alignerr stole my money

First, they say they will pay hourly. If I calculate paid by hour rate my amount is > $6000.

Then they come back and say payment will be made only for accepted tasks. But dude, tasks worth $4500 were accepted. I have proof.

Then they email again saying that a few tasks were rejected by the client. No visibility into which tasks were rejected or why. Only $1500 received.

When they need work done on time, they bombard you with emails every hour, make false increase in hourly rate and remove all barriers so that more people can work without a quiz or interview. In reality, their intention seems to be to get the work done without paying for it. They always hire fresh people to exploit, basically make false claim to get the work done from you with words like - bonus, hourly pay instead of pay per task approved, who controls the approval. Platforms like Snorkel give visibility directly whether the client accepted or not.

Once they have all the data they need to submit to the client and get paid, when it comes to disbursing payments to labelers, they make all sorts of excuses to avoid paying you for your hard work. There is no transparency and no way to contact support. They remove you from the project and take away your ability to contact your peers on Discord.

The leads always sounded fishy. I will wait a few more days to see if the unpaid payment issue is resolved. If it isn't, I will name and shame this practice to all their clients.

You've got blood on your hands.

Guys they are not same league as Mercor. Please do not belive every word they say and protect your human hours / brains by not committing fully. FQ to the Founder.

This post was removed from r/alignerr and they blocked me instead of resolving issues.

u/RandyDandy007 — 5 days ago
▲ 475 r/AIEvaluators+2 crossposts

I do data annotation as my full time income. After a year of applying and stacking projects here is what worked for me + platform list.

I’m sharing this because I know how frustrating this process can be, but there is hope. It took me a full year of massive effort and more hours of applying than I can count, but data annotation is now my full-time income. Today, I actually have more project offers than I can accept, and every new contract seems better than the last. Once you prove yourself on a platform, doors start opening fast.

Here are the key strategies that helped me turn things around:

1. Resume & Outreach

  • Keep LinkedIn & Resumes Updated: List your full, relevant experience. Once your profiles are optimized, recruiters will start reaching out to you directly via email and LinkedIn.
  • Keyword Optimization: I ask AI for keywords recruiters or platforms might be looking for, then optimize my resume around them.

2. Interview Prep & Execution

  • Treat Every Interview as Practice: Shifting to this mindset takes off the pressure.
  • Keep On-Screen "Cheat Sheets": I stick sticky notes around my monitor with key industry keywords so I don't blank out from nervousness.
  • Prep with AI: Practice answering prompts with Gemini ahead of time.
  • Use the STAR Method: Structure your answers using Situation, Task, Action, Result to keep responses clear and focused.
  • Ask Clarifying Questions: If you get stuck on a question, ask a clarifying question to buy yourself extra time to formulate a thoughtful answer.

3. Platforms to Look Into

If you’re looking for places to apply, here is a breakdown of platforms currently active or worth checking out:

  • Handshake AI: Lots of active projects currently.
  • Turing: Great option with steady project volume.
  • Meridial Marketplace: Excellent if you are interested in Search Quality Evaluation (this is currently my main focus, though they have other projects too).
  • Innodata: Pay can be lower than some, but the contracts offer more stability than standard gig platforms.
  • OneForma: Offers lower pay rates on average, but they have a high volume of open opportunities.
  • RemoExperts: Great if you have a degree. (Tip: If you don't have a formal degree, submit a document detailing your equivalent educational/work experience—that’s what I did!)
  • Mercor: Heard great things from others in the space (considering taking their AI interview test soon).
  • AfterQuery: Another solid platform worth exploring.

It takes time, trial, and error, but the investment pays off. Keep applying, keep practicing, and don't take initial rejections to heart!

Hope this helps someone who might be feeling discouraged today.

Yes I used AI to help format and rewrite the post. If I had not you would not been able to read my amazing tips in the wall of test. What kind of AI trainer would I be if I did not use AI in my daily life.

A year ago I was on reddit reading post envying folks. A post like this motivated me to put myself out there and try. And try I did. I landed a contract and was over the moon. 3 months later it ended suddenly and I was DEVISTATED! But I applied like it was my full time job. I WANTED that money, that next contract motivated me. I had zero experience about a year ago. Well besides my 22 years professional experience. Now I am out here feeling like I can help those that were in my shoes not many months ago. If this post inspires one person to go apply, or if ONE person uses ONE of my tips to land a job, I will have accomplished my goal. The contracts are out there. AI is BOOMING. But you have to put in the work. It might take 6 months for the contracts to start rolling in, but trust me they will. Thank me in a few months when you are turning down contracts or you have too many you simply cannot take on another. :)

Have a good day everyone. Happy annotating. Maybe I will see you on a project.

Oh that reminds me. Apply to jobs you do not feel qualified for. I did. And followed up with an email 3 days later. I got the job and managed 3 data collection projects. My contract has not ended and the company is growing, with my help they have started offering more projects in the US. You can never know until you try. And hard work does pay off. Confidence, resumes, and networks grow. Good luck guys! ❤️

reddit.com
u/Frenzy_77 — 11 days ago

Is Fleet.ai legit?

I see mixed reports.

it worthwhile to do this task (unpaid)?
Given that task is unpaid - Is asking for document verification a red flag?

u/One_Weather_9417 — 13 days ago