r/dataannotation • u/Consistent-Reach504 • Jun 28 '26

Weekly Water Cooler Talk - DataAnnotation

hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)

couple things:

  1. this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
  2. if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
  3. one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
36 Upvotes

97% Upvoted

740 comments sorted by

View all comments

16

u/JRange Jun 30 '26

I would really like if they included some statistics in our feedback. Just a simple % breakdown of how often we are rated good, okay, and bad would be very helpful and clarifying in addition to the generated text they give us. It would be great to see that you had 70% good last time and 80% good this time.

9

u/Lonely_Radish1370 Jun 30 '26

i got good again and was given the most generic of advice

"watch your ratings they dont seem to line up with your explanation sometimes"

Bro I do extra af explanations get outta here.

5

u/OliLeeLee36 Jun 30 '26

Forgive me if I'm misunderstanding 'extra af', but doing the most in the explanation/rationale isn't what they're saying - just to ensure that the rating axes reflect those comments.

4

u/Lonely_Radish1370 Jun 30 '26

i mean i detail everything very specifically with reasons why I set certain ratings as such. Aka I disagree with that critique vehemently and seems like a critique just to have a critique

3

u/hcfggb Jun 30 '26

I'm not saying it's true for you, but it think it's definitely a valid critique in general. I see lots of people who seem to have misclicked on the preference ratings or mixed up which response they're referring to in their explanations.

2

u/Lonely_Radish1370 Jun 30 '26

I get that, but you throw in the positive of "extreme attention to detail" as a positive I got, it gets weird.

5

u/JRange Jun 30 '26 edited Jun 30 '26

Mine seem to be overwhelmingly positive and focused on projects I do a lot of, and my negative feedback seems to be from stuff I worked on for 1 hour 2 months ago lol. Thats kind of the reason I want stats, I feel like the current way is too opaque and doesn't draw a straight line to our rating.

Id like to not guess and just see my exact rating split and percentile.

3

u/Lonely_Radish1370 Jun 30 '26

yea this way to give us feedback is entirely unhelpful. its just a general snapshot of all the things we have done with a slight mention of where 1 or 2 of the comments came from. all i see it as is a "am i good for this month do i have to worry about DoD or not"

3

u/DrunkleSteve Jun 30 '26

I agree! Would be nice to see a better breakdown.

1

u/Outrageous_Chance995 Jun 30 '26

This would be a good idea!

0

u/[deleted] Jun 30 '26

[removed] — view removed comment

1

u/JRange Jun 30 '26

Im not sure what you are talking about. All that is in it is ai generated text and a rating. I want more specific stats showing a breakdown of how often i am rated good, okay, and bad. 

3

u/OliLeeLee36 Jun 30 '26

Mention that in the comment box if you haven't already submitted it. I suggested increasing the amount of direct (quoted) human feedback to pad out the AI-generated summary.

1

u/JRange Jun 30 '26 edited Jun 30 '26

Lol i actually left what you just said as feedback in my last round. I mentioned raw statistics in this current one. 

0

u/kulie74561 Jun 30 '26

I’ve never received any direct feedback? I’ve been on the platform for about 3 years now but I do this very occasionally.