Leveraging statistical information in fine-grained financial sentiment analysis

Han ZHANG, Zongxi LI, Haoran XIE, Raymond Y. K. LAU, Kwok Shing CHENG, Qing LI, Dian ZHANG

Research output: Contribution to journalArticlespeer-review

1 Citation (Scopus)

Abstract

The recent development of deep learning-based natural language processing (NLP) methods has fostered many downstream applications in various fields. As one of the applications in the financial industry, fine-grained financial sentiment analysis (FSA) aims to understand the sentimental orientation, i.e., bullish or bearish, of financial texts by predicting the polarity score and has been widely applied in the financial industry stock-related opinion mining. Because of the lack of a large-scale labeled dataset and the domain-dependent nature, FSA is challenging. Previous works mainly focus on constructing and exploiting handcrafted lexicons that encode expert knowledge to enhance the semantic features in decision making, which yields improvements but are expensive to acquire. This paper proposes a lightweight regression model incorporating the statistical distribution of a term over the polarity range, say between − 1 and 1, to address the fine-grained FSA task. More concretely, we first count each word’s appearance at different polarity intervals and produce a statistic-based representation for each text, which will be encoded as a corpus-level statistical feature vector by an autoencoder. Subsequently, the obtained feature vector will be integrated with the semantic feature vector in the regression model. Our experiments show such a model can produce significant improvements compared with the baseline models on two FSA subsets, i.e., news headlines and microblogs, without a computational overhead. Furthermore, we notice the signs that lexicon-based approaches have neglected can play an important role in FSA. Copyright © 2022 The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
Original languageEnglish
Pages (from-to)513–531
JournalWorld Wide Web
Volume25
Issue number2
Early online date05 Feb 2022
DOIs
Publication statusPublished - Mar 2022

Citation

Zhang, H., Li, Z., Xie, H., Lau, R. Y. K., Cheng, G., Li, Q., & Zhang, D. (2022). Leveraging statistical information in fine-grained financial sentiment analysis. World Wide Web, 25(3), 513–531. doi: 10.1007/s11280-021-00993-1

Keywords

  • Financial sentiment analysis
  • Sentiment analysis
  • Natural language processing
  • Information retrieval

Fingerprint

Dive into the research topics of 'Leveraging statistical information in fine-grained financial sentiment analysis'. Together they form a unique fingerprint.