|
ИСТИНА |
Войти в систему Регистрация |
Интеллектуальная Система Тематического Исследования НАукометрических данных |
||
Improving Neural Abstractive Summarization with Reliable Sentence Samplingстатья
- Авторы: Chernyshev D., Dobrov B.
- Сборник: International Conference on Data Analytics and Management in Data Intensive Domains
- Серия: Communications in Computer and Information Science
- Том: 1620
- Год издания: 2022
- Место издания: Springer Cham
- Первая страница: 246
- Последняя страница: 261
- DOI: 10.1007/978-3-031-12285-9_16
- Аннотация: State-of-the-art abstractive summarization models are able to produce summaries for various types of sources with quality comparable to human written texts. However, despite the fluency, the generated summaries are often erroneous due to factual inconsistencies caused by neural hallucinations. In this work, we study possible ways of reducing the hallucination rate during abstractive summarization. We compare three different techniques aimed at improving the correctness of the training procedure: control tokens, truncated loss, and dataset cleaning. To control hallucination rate outside of the training, we propose an improved algorithm for summary sampling - reliable sentence sampling. The algorithm utilizes fact precision metrics to sample the most reliable sentences for an abstractive summary. By conducting the human evaluation, we demonstrate the algorithm’s efficiency in preserving summary factual consistency.
- Добавил в систему: Добров Борис Викторович