File(s) under permanent embargo
Crowd-sourced knowledge bases
conference contribution
posted on 2023-05-23, 07:05 authored by Kim, YS, Byeong KangByeong Kang, Ryu, SH, Compton, P, Han, SC, Menzies, TCrowdsourcing is a low cost way of obtaining human judgements on a large number of items, but the knowledge in these judgements is not reusable and further items to be processed require further human judgement. Ideally one could also obtain the reasons people have for these judgements, so the ability to make the same judgements could be incorporated into a crowd-sourced know- ledge base. This paper reports on experiments with 27 students building know- ledge bases to classify the same set of 1000 documents. We have assessed the performance of the students building the knowledge bases using the same stu- dents to assess the performance of each other’s knowledge bases on a set of test documents. We have explored simple techniques for combining the knowledge from the students. These results suggest that although people vary in document classification, simple merging may produce reasonable consensus knowledge bases.
History
Publication title
Proceedings of the12th Pacific Rim Knowledge Acquisition WorkshopEditors
D Richards, BH KangPagination
258-271ISBN
978-3-642-32541-0Department/School
School of Information and Communication TechnologyPublisher
SpringerPlace of publication
Berlin HeidelbergEvent title
12th Pacific Rim Knowledge Acquisition Workshop (PKAW 2012)Event Venue
Kuching, MalaysiaDate of Event (Start Date)
2012-09-05Date of Event (End Date)
2012-09-06Rights statement
Copyright 2012 SpringerRepository Status
- Restricted