Optimal Inference in Crowdsourced Classification via Belief Propagation
SCIE
SCOPUS
- Title
- Optimal Inference in Crowdsourced Classification via Belief Propagation
- Authors
- Jungseul Ok; Sewoong Oh; Jinwoo Shin; Yung Yi
- Date Issued
- 2018-09
- Publisher
- Institute of Electrical and Electronics Engineers
- Abstract
- Crowdsourcing systems are popular for solving large-scale labeling tasks with low-paid workers. We study the problem of recovering the true labels from the possibly erroneous crowdsourced labels under the popular Dawid-Skene model. To address this inference problem, several algorithms have recently been proposed, but the best known guarantee is still significantly larger than the fundamental limit. We close this gap by introducing a tighter lower bound on the fundamental limit and proving that the belief propagation (BP) exactly matches the lower bound. The guaranteed optimality of BP is the strongest in the sense that it is information-theoretically impossible for any other algorithm to correctly label a larger fraction of the tasks. Experimental results suggest that the BP is close to optimal for all regimes considered and improves upon competing the state-of-the-art algorithms.
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/100544
- DOI
- 10.1109/TIT.2018.2846582
- ISSN
- 0018-9448
- Article Type
- Article
- Citation
- IEEE Transactions on Information Theory, vol. 64, no. 9, page. 6127 - 6138, 2018-09
- Files in This Item:
- There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.