| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2023-09-21 15:25 Assignment Methods of Crowdsourcing Workers based on Difficulties of Tasks Shota Kidokoro, Yu Suzuki (Gifu Univ)  DE2023-15 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Improving the overall labeling quality of tasks in crowdsourcing is an important issue. Our study aims to improve the quality of labeling. Therefore, we propose task assignment methods considering the accuracy of labeling for workers and the difficulty of labeling for each task. Crowdsourcing involves variation tasks, some difficult to label and others easier. There is also variation in the accuracy of labeling for each worker. The worker's labeling accuracy improves or decreases depending on the labeling difficulty, just as the worker's labeling accuracy improves when labeling less difficult tasks. We consider that this variation in labeling accuracy due to labeling difficulty varies from worker to worker. We consider assigning easy labeling tasks to workers with a low percentage of correct answers and difficulty labeling tasks to workers with a high percentage of correct answers. These assignment methods allow us to increase the percentage of correct answers to difficulty tasks without decreasing the percentage of correct answers to easy tasks much, compared to when tasks are assigned randomly. Therefore, we believe the average percentage of correct answers for the overall task will increase. Assuming that we use the task given the difficulty of labeling in advance, we employ these assignment methods and conduct an experiment to check its validity. The experimental results show the effectiveness of our proposed methods in improving the overall labeling quality of tasks. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Crowdsourcing / Difficulties of tasks / Assignment methods / / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 123, no. 192, DE2023-15, pp. 25-30, Sept. 2023. | |
| Paper # | DE2023-15 | |
| Date of Issue | 2023-09-14 (DE) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | DE2023-15 |
|
| Conference Information | |
| Committee | DE IPSJ-DBS IPSJ-IFAT |
| Conference Date | 2023-09-21 - 2023-09-22 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kitakyushu International Conference Center |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Bigdata management, information retrieval, knowledge discovery, etc. |
| Paper Information | |
| Registration To | DE |
| Conference Code | 2023-09-DE-DBS-IFAT |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Assignment Methods of Crowdsourcing Workers based on Difficulties of Tasks |
| Sub Title (in English) | |
| Keyword(1) | Crowdsourcing |
| Keyword(2) | Difficulties of tasks |
| Keyword(3) | Assignment methods |
| Keyword(4) | |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Shota Kidokoro |
| 1st Author's Affiliation | Gifu University (Gifu Univ) |
| 2nd Author's Name | Yu Suzuki |
| 2nd Author's Affiliation | Gifu University (Gifu Univ) |
| 3rd Author's Name | |
| 3rd Author's Affiliation | () |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2023-09-21 15:25:00 |
| Presentation Time | 25 minutes |
| Registration for | DE |
| Paper # | DE2023-15 |
| Volume (vol) | vol.123 |
| Number (no) | no.192 |
| Page | pp.25-30 |
| #Pages | 6 |
| Date of Issue | 2023-09-14 (DE) |
[Return to Top Page]