Evaluating Crowdsourcing Participants in the Absence of G...
Ramanathan Subramanian, Romer Rosales, Glenn Fung, Jennifer Dy·2016-05-31·via cs.HC updates on arXiv.org
Given a supervised/semi-supervised learning scenario where multiple annotators are available, we consider the problem of identification of adversarial or unreliable annotators.