I was working on a rate and review that included Spanish text. I needed to use a translator to understand the text in full. Unfortunately, the first one that popped up was ChatGPT. I immediately exed out, but I’m afraid it probably flagged my account. I emailed admin with the task ID.
Any thoughts about this?
Y’all ever work all day on tasks that hurt your brain and then when it’s time to end the day your favorite types of projects become available and tempt you to stay on the platform past your prime? Just me? 😤😵💫
🙏 be there in the morning sweet ones!
Okay y’all. This is confusing me and I’m not even sure if I’ll make sense. But I need help so I’m gonna try.
I was tasked with creating a rubric for a response that was already scored. The category was factuality. One of the responses contained a hallucination.
When creating my rubric, I could not figure out how to capture the hallucination (I had to refer to what the LLM suggested, even though I wasn’t confident with it).
This is an example:
User prompt: Summarize the document.
Response B: Innacurately mixes up details.
Rubric: “The response should not state “X”
I don’t know how to explain it any better than that without giving away the whole context. I just feel like a rubric would not have inherently said what I had to say to justify this. This felt specifically case sensitive. Is this my job? Am I supposed to show why this model failed? Or should I have just let the response pass through based on my rubric (if I excluded this).
Okay DA veterans, I need help. Newbie here so be kind.
I’ve been working on projects and R&Rs.
There seems to be a confusion about what comes “instruction” and what comes as “overall quality”.
From what I understand, as long as the model is trying to answer the question, failure to do so in a good way does not mean it failed to follow instruction. It feels like a very “gray” area.
Hellllp
I have been on the platform for about 2.5 weeks. I just received some feedback. This feedback was for my overall work for multiple projects.
I received some very great positive feedback and some constructive criticism. My overall feedback was “Room for Improvement”.
I was wondering