This paper introduces PyCantonese, an open-source Python library for Cantonese linguistics and natural language processing. After the library design, implementation, corpus data format, and key datasets included are introduced, the paper provides an overview of the currently implemented functionality: stop words, handling Jyutping romanization, word segmentation, part-of-speech tagging, and parsing Cantonese text. Copyright © 2022 European Language Resources Association (ELRA), licensed under CC-BY-NC-4.0.
|Title of host publication||Proceedings of the 13th Language Resources and Evaluation Conference|
|Place of Publication||France|
|Publisher||European Language Resources Association|
|Publication status||Published - Jun 2022|
CitationLee, J. L., Chen, L., Lam, C., Lau, C. M., & Tsui, T.-H. (2022). PyCantonese: Cantonese linguistics and NLP in python. In Proceedings of the 13th Language Resources and Evaluation Conference (pp. 6607-6611). France: European Language Resources Association.
- Word segmentation
- Part-of-speech tagging
- Stop words