Explainable Sentiment Analysis: A Hierarchical Transformer-Based Extractive Summarization Approach
| العنوان: | Explainable Sentiment Analysis: A Hierarchical Transformer-Based Extractive Summarization Approach |
|---|---|
| المؤلفون: | Felice Dell'Orletta, Luca Bacco, Andrea Cimino, Mario Merone |
| المصدر: | Electronics, Vol 10, Iss 2195, p 2195 (2021) Electronics Volume 10 Issue 18 |
| بيانات النشر: | MDPI AG, 2021. |
| سنة النشر: | 2021 |
| مصطلحات موضوعية: | TK7800-8360, Computer Networks and Communications, Computer science, computer.software_genre, Task (project management), explainability, extractive summarization, Electrical and Electronic Engineering, Architecture, hierarchical transformers, Transformer (machine learning model), Hierarchy, business.industry, Suite, Sentiment analysis, Benchmarking, Automatic summarization, Hardware and Architecture, Control and Systems Engineering, sentiment analysis, Signal Processing, Artificial intelligence, Electronics, business, computer, Natural language processing |
| الوصف: | In recent years, the explainable artificial intelligence (XAI) paradigm is gaining wide research interest. The natural language processing (NLP) community is also approaching the shift of paradigm: building a suite of models that provide an explanation of the decision on some main task, without affecting the performances. It is not an easy job for sure, especially when very poorly interpretable models are involved, like the almost ubiquitous (at least in the NLP literature of the last years) transformers. Here, we propose two different transformer-based methodologies exploiting the inner hierarchy of the documents to perform a sentiment analysis task while extracting the most important (with regards to the model decision) sentences to build a summary as the explanation of the output. For the first architecture, we placed two transformers in cascade and leveraged the attention weights of the second one to build the summary. For the other architecture, we employed a single transformer to classify the single sentences in the document and then combine the probability scores of each to perform the classification and then build the summary. We compared the two methodologies by using the IMDB dataset, both in terms of classification and explainability performances. To assess the explainability part, we propose two kinds of metrics, based on benchmarking the models’ summaries with human annotations. We recruited four independent operators to annotate few documents retrieved from the original dataset. Furthermore, we conducted an ablation study to highlight how implementing some strategies leads to important improvements on the explainability performance of the cascade transformers model. |
| وصف الملف: | application/pdf |
| تدمد: | 2079-9292 |
| الوصول الحر: | https://explore.openaire.eu/search/publication?articleId=doi_dedup___::031618c6617846855bcee46d1346cc28Test https://doi.org/10.3390/electronics10182195Test |
| حقوق: | OPEN |
| رقم الانضمام: | edsair.doi.dedup.....031618c6617846855bcee46d1346cc28 |
| قاعدة البيانات: | OpenAIRE |
| تدمد: | 20799292 |
|---|