|
ИСТИНА |
Войти в систему Регистрация |
ИСТИНА ИНХС РАН |
||
Comparing models of morpheme analysis for Russian words based on machine learningстатья
Информация о цитировании статьи получена из
Scopus
Дата последнего поиска статьи во внешних источниках: 23 ноября 2020 г.
- Авторы: Bolshakova E.I., Sapin A.S.
- Сборник: Komp'juternaja Lingvistika I Intellektual'nye Tehnologii
- Том: 18
- Год издания: 2019
- Место издания: РГГУ Москва
- Первая страница: 104
- Последняя страница: 113
- Аннотация: The paper reports on the experimental comparison of several machine learning models proposed in recent years for automatic morpheme segmentation of Russian words, including conditional random fields (CRF), sequence-to-sequence neural network (Seq2seq) , convolutional neural network (CNN) model, as well as a new model we have developed with the aid of gradient boosted decision trees (GBDT). For more complete research, in our experiments we have also evaluated the semi-supervised method of Morfessor. All the morpheme analysis models being compared are briefly described in the paper, some of them perform only segmentation of words into morphs, the other produce segmentation with classification of resulted morphs. Since for Russian language linguistics rules for splitting words into morphs (and also the classification of some morphs) may differ, the experiments were performed for two data sets differing in labeling, which are obtained respectively from CrossLexica's dictionary and Tikhonov's dictionary. The experimental evaluation has shown that two best models of morpheme segmentation with classification, namely GBDT and CNN models have comparable quality, giving about 86-94% of word-level accuracy.
- Добавил в систему: Большакова Елена Игоревна