October 06, 2019
The most basic way to find batches is just to do a search on mturk and choose the "sort by" option of "hits available - most first" forums/groups there are many forums or online groups that have threads where people post about good batches that pop up throughout the day.. That covers the basics of getting large batches of images labelled on mturk. after this there are a few other things to check out, including how to approve or reject work from workers, how to use qualifications, how to send workers bonuses, and more from our requester ui guide.. Checking results. now we can check our batch against our set of known answers. to do this, go to your knownanswers sheet and add a column called batch answer with a formula similar to the following that will lookup the answer for the batch from your finalanswers sheet. =vlookup(a2,finalanswers!a:b,2,false).
They do big batches where they give you a google link to some one and show you a picture and ask if the person is it. fast and fun. they take a long time to approve the hit though.. Do you or does anyone else remember if the old viral mturk or mountain or (good) sergey hits had numbers requirements? i want to say my earnings went up significantly when i was finally able to do those batch hits, and that was directly related to my #s, but i'm not sure if that was the reason or if i just happened to discover them at the same. If you have submitted plural batches, i.e. batches for which two or more turkers are allowed to work on any given sample, one of the first things you will have to do once you have received the responses to your submission is assess how good or bad interannotator agreement (also known as interrater reliability or concordance) was..