تقرير
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering
| العنوان: | TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering |
|---|---|
| المؤلفون: | Sun, Yueqing, Zhang, Yu, Qi, Le, Shi, Qi |
| سنة النشر: | 2022 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Computation and Language, Computer Science - Artificial Intelligence |
| الوصف: | Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-trained language models (PrLMs) to generate fixed types of knowledge, which have poor generalization ability. In this paper, we aim to address the above limitation by leveraging the implicit knowledge stored in PrLMs and propose a two-stage prompt-based unsupervised commonsense question answering framework (TSGP). Specifically, we first use knowledge generation prompts to generate the knowledge required for questions with unlimited types and possible candidate answers independent of specified choices. Then, we further utilize answer generation prompts to generate possible candidate answers independent of specified choices. Experimental results and analysis on three different commonsense reasoning tasks, CommonsenseQA, OpenBookQA, and SocialIQA, demonstrate that TSGP significantly improves the reasoning ability of language models in unsupervised settings. Our code is available at: https://github.com/Yueqing-Sun/TSGPTest. Comment: Findings of EMNLP2022 |
| نوع الوثيقة: | Working Paper |
| الوصول الحر: | http://arxiv.org/abs/2211.13515Test |
| رقم الانضمام: | edsarx.2211.13515 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |