Comparing Statistical Models for Retrieval based Question-answering Dialogue: BERT vs Relevance Models

Autor/innen

DOI:

https://doi.org/10.32473/flairs.36.133386

Schlagworte:

Natural Language Processing, Relevance Modelling, Transformers, Natural Language Dialogue

Abstract

In this paper, we compare the performance of four models in a retrieval based question answering dialogue task on two moderately sized corpora (~ 10,000 utterances). One model is a statistical model and uses cross language relevance while the others are deep neural networks utilizing the BERT architecture along with different retrieval methods. The statistical model has previously outperformed LSTM based neural networks in a similar task whereas BERT has been proven to perform well on a variety of NLP tasks, achieving state-of-the-art results in many of them. Results show that the statistical cross language relevance model outperforms the BERT based architectures in learning question-answer mappings. BERT achieves better results by mapping new questions to existing questions.

Downloads

Veröffentlicht

2023-05-08

Zitationsvorschlag

Pal, D., Leuski, A., & Traum, D. (2023). Comparing Statistical Models for Retrieval based Question-answering Dialogue: BERT vs Relevance Models. The International FLAIRS Conference Proceedings, 36(1). https://doi.org/10.32473/flairs.36.133386

Ausgabe

Rubrik

Special Track: Applied Natural Language Processing