دورية أكاديمية

Few-shot Sentiment Analysis Based on Adaptive Prompt Learning and Contrastive Learning

التفاصيل البيبلوغرافية
العنوان: Few-shot Sentiment Analysis Based on Adaptive Prompt Learning and Contrastive Learning
المؤلفون: Shi , Cong, Zhai, Rui, Song, Yalin, Yu, Junyang, Li, Han, Wang, Yingqi, Wang, Longge
المصدر: Information Technology and Control ; Vol. 52 No. 4 (2023); 1058-1072 ; 2335-884X ; 1392-124X
بيانات النشر: Kaunas University of Technology
سنة النشر: 2024
مصطلحات موضوعية: Few-shot Sentiment Analysis, Adaptive Prompt Learning, Contrastive Learning, Dot-Product Attention, Semantic information of tests
الوصف: Traditional deep learning-based strategiesfor sentiment analysis relyheavily on large-scale labeled datasets for model training, but these methods become less effective when dealing with small-scale datasets. Fine-tuning large pre-trained models on small datasets is currently the most commonly adopted approach to tackle this issue. Recently, prompt-based learning has gained significant attention as a promising research area.Although prompt-based learning has the potential to address data scarcity problems by utilizing prompts to reformulate downstream tasks, the current prompt-based methods for few-shot sentiment analysis are still considered inefficient. To tackle this challenge, an adaptive prompt-based learning method is proposed, which includes two aspects. Firstly, an adaptive prompting construction strategy is proposed, which cancapture the semantic information of texts by utilizinga dot-product attention structure, improving the quality of the prompttemplates. Secondly, contrastive learning is applied to the implicit word vectors obtained twice during the training stage to alleviate over-fitting in few-shot learning processes. This improves themodel’s generalization abilityby achieving data enhancement while keeping thesemantic information of input sentences unchanged. Experimental results on the ERPSTMT datasetsof FewCLUE demonstratethat the proposed method have great ability toconstruct suitableadaptive prompts and outperforms the state-of-the-art baselines.
نوع الوثيقة: article in journal/newspaper
وصف الملف: application/pdf
اللغة: English
العلاقة: https://itc.ktu.lt/index.php/ITC/article/view/34021/16205Test; https://itc.ktu.lt/index.php/ITC/article/view/34021Test
الإتاحة: https://itc.ktu.lt/index.php/ITC/article/view/34021Test
حقوق: Copyright (c) 2023 Information Technology and Control
رقم الانضمام: edsbas.6091D610
قاعدة البيانات: BASE