دورية أكاديمية
MFIRA: Multimodal Fusion Intent Recognition Algorithm for AR Chemistry Experiments
| العنوان: | MFIRA: Multimodal Fusion Intent Recognition Algorithm for AR Chemistry Experiments |
|---|---|
| المؤلفون: | Zishuo Xia, Zhiquan Feng, Xiaohui Yang, Dehui Kong, Hong Cui |
| المصدر: | Applied Sciences, Vol 13, Iss 14, p 8200 (2023) |
| بيانات النشر: | MDPI AG, 2023. |
| سنة النشر: | 2023 |
| المجموعة: | LCC:Technology LCC:Engineering (General). Civil engineering (General) LCC:Biology (General) LCC:Physics LCC:Chemistry |
| مصطلحات موضوعية: | multimodal fusion, virtual experiment, intelligent teaching, human-computer interaction, intention understanding, Technology, Engineering (General). Civil engineering (General), TA1-2040, Biology (General), QH301-705.5, Physics, QC1-999, Chemistry, QD1-999 |
| الوصف: | The current virtual system for secondary school experiments poses several issues, such as limited methods of operation for students and an inability of the system to comprehend the users’ operational intentions, resulting in a greater operational burden for students and hindering the goal of the experimental practice. However, many traditional multimodal fusion algorithms rely solely on individual modalities for the analysis of users’ experimental intentions, failing to fully utilize the intention information for each modality. To rectify these issues, we present a new multimodal fusion algorithm, MFIRA, which intersects and blends intention probabilities between channels by executing parallel processing of multimodal information at the intention layer. Additionally, we developed an augmented reality (AR) virtual experiment platform based on the Hololens 2, which enables students to conduct experiments using speech, gestures, and vision. Employing the MFIRA algorithm, the system captures users’ experimental intent and navigates or rectifies errors to guide students through their experiments. The experimental results indicate that the MFIRA algorithm boasts a 97.3% accuracy rate in terms of interpreting users’ experimental intent. Compared to existing experimental platforms, this system is considerably more interactive and immersive for students and is highly applicable in secondary school experimental chemistry classrooms. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2076-3417 |
| العلاقة: | https://www.mdpi.com/2076-3417/13/14/8200Test; https://doaj.org/toc/2076-3417Test |
| DOI: | 10.3390/app13148200 |
| الوصول الحر: | https://doaj.org/article/96d2e954014d40b6b357024e8091bc8fTest |
| رقم الانضمام: | edsdoj.96d2e954014d40b6b357024e8091bc8f |
| قاعدة البيانات: | Directory of Open Access Journals |
Full Text Finder | تدمد: | 20763417 |
|---|---|
| DOI: | 10.3390/app13148200 |