Building Dataset and Morpheme Segmentation Model for Russian Word Forms

Авторы: Bolshakova E.I., Sapin A.S.
Сборник: Computational Linguistics and Intellectual Technologies: Papers from the Annual International Conference ''Dialogue" (2021)
Том: 20
Год издания: 2021
Место издания: Москва
Первая страница: 154
Последняя страница: 161
Аннотация: The paper describes a way to generate a dataset of Russian word forms, which is needed to build an appropriate neural model for morpheme segmentation of word forms. The developed generation procedure produces word forms segmented into morphs that are classified by morpheme types, based on existing dataset of segmented lemmas and additional dictionary data, as well as fine-grained classification of Russian inflectional paradigms, which makes it possible to correctly process word forms with alternating consonants and fluent vowels in endings. The built repre-sentative dataset (more than 1,6 million word forms) was used to develop a neural model for morpheme segmentation of word forms with classification of segmented morphs. The experiments have shown that in detecting morphs boundaries the model has comparable quality with the best segmentation models for lemmas (98% of F-measure), slightly outperforming them in word-level classification accuracy (with score 91%).
Добавил в систему: Большакова Елена Игоревна

	ИСТИНА	Войти в систему Регистрация
	Интеллектуальная Система Тематического Исследования НАукометрических данных
	Главная Поиск Статистика О проекте Помощь

ИСТИНА