Suggestion for mturk enhancement

0

I've noticed that sometimes workers accept my HIT but don't proceed to actually submit it. It would be nice to know why a user has done this. Did the user actively return the HIT or did the HIT simply expire in their queue. If a user actively returns it, maybe there could be a "reason" that a user could select such as "confusing instructions", "pay too low", "privacy concern", or "other".

userbob
asked 4 years ago174 views
4 Answers
0

Hello,

That's a great suggestion! I think there's a lot of value to knowing whether or not perhaps you've timed your HIT to expire too quickly, which a notification like this could help determine. It's also good to know why Workers are returning the HIT to you, as they don't always have the opportunity to send you a quick message if they don't do so before hand.

While this is no guarantee that this type of feature will be implemented, I'm happy to forward this feedback to our Business team.

Thank you!

-Adam J

AWS
answered 4 years ago
0

Adam,

I recall there used to be qualification ids for the rate at which users abandoned or returned HITs. However, I couldn't find these documented anymore. I'm trying to increase the speed at which my HITs get completed; so I was considering adding a qualification based on these rates so that I can minimize the time that my HITs are sitting in worker's queue. If these qualification ids still exist, please let me know where they are documented.

Thanks!

userbob
answered 4 years ago
0

Hey userbob,

That's correct, those existed as System Qualifications for a time, but those Qualifications have since been removed and are not available. I understand you're very familiar with the Mechanical Turk website and I wouldn't want to make a recommendation for something you've most likely already tried. Even so, I can't help but suggest using the assignment duration option to put a limit on how long a Worker can hold onto any assignment they've accepted from you.

Of course, this can be a bit of a double-edged sword, so-to-speak. On one hand, you'll limit how long any one Worker holds onto those assignments. On the other, I know from experience that it's common to accept multiple assignments and work through them in succession. If there's any kind of delay or issue that prevents someone from getting to your assignment in time, they miss out on being able to complete your HIT.

-Adam J

AWS
answered 4 years ago
0

I was looking at the mturk worker site today and I noticed that there is an option to "Report this HIT" at the bottom left of a HITs page. The worker is able to indicate if they are reporting the HIT because they think there is a policy violation or if they think that the HIT is broken. It would be nice if requesters were notified when workers reported their HIT as being broken. I saw a conversation on reddit of workers asking if filling at that form has any result. I think most workers will be assuming that comments they enter there (when not related to a policy violation) would get forwarded to the requester.

Edited by: userbob on May 12, 2020 9:11 AM

userbob
answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions