Increased Accuracy Of Sequence To Sequence Models With The CNN Algorithm For Multi Response Ranking On Travel Service Conversations Based On Chat History

Main Article Content

Wahyu Wijaya Widiyanto
Uli Rizki
Edy Susena

Abstract

Building a chatbot cannot be separated from the knowledge base. The knowledge base can be obtained from data that has been labeled by the developer, documents that have been converted into pre-processing data, or information taken from social media. In this case, the data used as knowledge is chat history. In the chat history there are certainly many variations of answers and allowing a question to give rise to many answers. To overcome these multi responses, response was made. The existence of ranking, of course the response desired by the user will be more appropriate. Challenge in ranking is how to get the essence a question and find pairs questions and answers from the data. This can be solved by a sequence to sequence model. However, the problem that will arise is the consistency of the answers. The existence of a lot of chat history certainly raises many explanations, even though the question's essence is the same. For this reason the CNN algorithm as a solution to the problem. This research uses convolutional sequence to sequence which will be applied for ranking responses. We compare the efficiency of this model. By making comparisons, this model shows an accuracy of 86.7%

Downloads

Download data is not yet available.

Article Details

How to Cite
[1]
W. W. Widiyanto, U. Rizki, and E. Susena, “Increased Accuracy Of Sequence To Sequence Models With The CNN Algorithm For Multi Response Ranking On Travel Service Conversations Based On Chat History”, INFOTEL, vol. 12, no. 2, pp. 39-44, May 2020.
Section
Informatics

References

[1] Y. P. Ruan, Z. H. Ling, X. Zhu, Q. Liu, and J. C. Gu, “Generating diverse conversation responses by creating and ranking multiple candidates,” Comput. Speech Lang., vol. 62, p. 101071, 2020.
[2] R. Yan, D. Zhao, and E. Weinan, “Joint Learning of response ranking and next utterance suggestion in human-computer conversation system,” SIGIR 2017 - Proc. 40th Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., pp. 685–694, 2017.
[3] A. Chaturvedi et al., “CNN for Text-Based Multiple Choice Question Answering,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2019.
[4] D. Tao, X. Li, X. Wu, W. Hu, and S. J. Maybank, “Supervised tensor learning,” Knowl. Inf. Syst., vol. 13, no. 1, pp. 1–42, 2007.
[5] Y. Wu, W. Wu, C. Xing, Z. Li, and M. Zhou, “Sequential matching network: A new architecture for multi-turn response selection in retrieval-based chatbots,” ACL 2017 - 55th Annu. Meet. Assoc. Comput. Linguist. Proc. Conf. (Long Pap.), vol. 1, pp. 496–505, 2017.
[6] L. Yang et al., “Response ranking with deep matching networks and external knowledge in information-seeking conversation systems,” 41st Int. ACM SIGIR Conf. Res. Dev. Inf. Retrieval, SIGIR 2018, pp. 245–254, 2018.
[7] H. Ouchi and Y. Tsuboi, “Addressee and response selection for multi-party conversation,” EMNLP 2016 - Conf. Empir. Methods Nat. Lang. Process. Proc., no. Section 3, pp. 2133–2143, 2016.
[8] W. W. Widiyanto, S. Pariyasto, and D. Iskandar, “Prototype Analysis of Basic Words in Social Media in Indonesia,” Asian J. Res. Comput. Sci., vol. 5, no. 1, pp. 49–58, 2020.
[9] B. Wu, B. Wang, and H. Xue, “Ranking responses oriented to conversational relevance in chat-bots,” COLING 2016 - 26th Int. Conf. Comput. Linguist. Proc. COLING 2016 Tech. Pap., pp. 652–662, 2016.
[10] I. Shalyminov, O. Dušek, and O. Lemon, “Neural Response Ranking for Social Conversation: A Data-Efficient Approach,”in Proceeding of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI, pp. 1–8, 2018.
[11] A. Severyn, “Rank with CNN,” 2014.
[12] W. Yin, H. Schütze, B. Xiang, and B. Zhou, “Erratum: ‘ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs,’” Trans. Assoc. Comput. Linguist., vol. 4, pp. 566–567, 2016.
[13] J. Yu et al., “Modelling domain relationships for transfer learning on retrieval-based question answering systems in E-commerce,” WSDM 2018 - Proc. 11th ACM Int. Conf. Web Search Data Min., vol. 2018-Febua, pp. 682–690, 2018.
[14] H. Zhu, H. Chen, and R. Brown, “A sequence-to-sequence model-based deep learning approach for recognizing activity of daily living for senior care,” J. Biomed. Inform., vol. 84, no. February, pp. 148–158, 2018.