Bootstrapping social emotion classification with semantically rich hybrid neural networks

Xiangsheng LI, Yanghui RAO, Haoran XIE, Yiu Keung Raymond LAU, Jian YIN, Fu Lee WANG

Research output: Contribution to journalArticlespeer-review

49 Citations (Scopus)


Social emotion classification aims to predict the aggregation of emotional responses embedded in online comments contributed by various users. Such a task is inherently challenging because extracting relevant semantics from free texts is a classical research problem. Moreover, online comments are typically characterized by a sparse feature space, which makes the corresponding emotion classification task very difficult. On the other hand, though deep neural networks have been shown to be effective for speech recognition and image analysis tasks because of their capabilities of transforming sparse low-level features to dense high-level features, their effectiveness on emotion classification requires further investigation. The main contribution of our work reported in this paper is the development of a novel model of semantically rich hybrid neural network (HNN) which leverages unsupervised teaching models to incorporate semantic domain knowledge into the neural network to bootstrap its inference power and interpretability. To our best knowledge, this is the first successful work of incorporating semantics into neural networks to enhance social emotion classification and network interpretability. Through empirical studies based on three real-world social media datasets, our experimental results confirm that the proposed hybrid neural networks outperform other state-of-the-art emotion classification methods. Copyright © 2017 IEEE.
Original languageEnglish
Pages (from-to)428-442
JournalIEEE Transactions on Affective Computing
Issue number4
Early online dateJun 2017
Publication statusPublished - 2017


Li, X., Rao, Y., Xie, H., Lau, Y. K. R., Yin, J., & Wang, F. L. (2017). Bootstrapping social emotion classification with semantically rich hybrid neural networks. IEEE Transactions on Affective Computing, 8(4), 428-442. doi: 10.1109/TAFFC.2017.2716930


  • Social emotion classification
  • Hybrid neural network
  • Sparse encoding
  • Transfer learning


Dive into the research topics of 'Bootstrapping social emotion classification with semantically rich hybrid neural networks'. Together they form a unique fingerprint.