Comparing Statistical Models for Retrieval based Question-answering Dialogue: BERT vs Relevance Models
DOI:
https://doi.org/10.32473/flairs.36.133386Keywords:
Natural Language Processing, Relevance Modelling, Transformers, Natural Language DialogueAbstract
In this paper, we compare the performance of four models in a retrieval based question answering dialogue task on two moderately sized corpora (~ 10,000 utterances). One model is a statistical model and uses cross language relevance while the others are deep neural networks utilizing the BERT architecture along with different retrieval methods. The statistical model has previously outperformed LSTM based neural networks in a similar task whereas BERT has been proven to perform well on a variety of NLP tasks, achieving state-of-the-art results in many of them. Results show that the statistical cross language relevance model outperforms the BERT based architectures in learning question-answer mappings. BERT achieves better results by mapping new questions to existing questions.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Debaditya Pal, Anton Leuski, David Traum
![Creative Commons License](http://i.creativecommons.org/l/by-nc/4.0/88x31.png)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.