Top K representative: A method to select representative samples based on K nearest neighbors

Kai YANG, Yi CAI, Zhiwei CAI, Haoran XIE, Tak Lam WONG, Wai Hong CHAN

Research output: Contribution to journalArticles

2 Citations (Scopus)

Abstract

Short text categorization involves the use of a supervised learning process that requires a large amount of labeled data for training and therefore consumes considerable human labor. Active learning is a way to reduce the number of manually labeled samples in traditional supervised learning problems. In active learning, the number of samples is reduced by selecting the most representative samples to represent an entire training set. Uncertainty sampling is a means of active learning but is easily affected by outliers. In this paper, a new sampling method called Top K representative (TKR) is proposed to solve the problem caused by outliers. However, TKR optimization is a nondeterministic polynomial-time hardness (NP-hard) problem, making it challenging to obtain exact solutions. To tackle this problem, we propose a new approach based on the greedy algorithm, which can obtain approximate solutions, and thereby achieve high performance. Experiments show that our proposed sampling method outperforms the existing methods in terms of efficiency. Copyright © Springer-Verlag GmbH Germany, part of Springer Nature 2017.
Original languageEnglish
Pages (from-to)2119-2129
JournalInternational Journal of Machine Learning and Cybernetics
Volume10
Issue number8
Early online date12 Dec 2017
DOIs
Publication statusPublished - Aug 2019

Citation

Yang, K., Cai, Y., Cai, Z., Xie, H., Wong, T.-L., Chan, W. H. (2019). Top K representative: A method to select representative samples based on K nearest neighbors. International Journal of Machine Learning and Cybernetics, 10(8), 2119-2129. doi: 10.1007/s13042-017-0755-8

Keywords

  • Active learning
  • Text categorization

Fingerprint Dive into the research topics of 'Top K representative: A method to select representative samples based on K nearest neighbors'. Together they form a unique fingerprint.