تقرير
Quantified Qualitative Analysis: Rubric Development and Inter-Rater Reliability as Iterative Design
| العنوان: | Quantified Qualitative Analysis: Rubric Development and Inter-Rater Reliability as Iterative Design |
|---|---|
| اللغة: | English |
| المؤلفون: | McCarthy, Kathryn S., Magliano, Joseph P., Snyder, Jacob O., Kenney, Elizabeth A., Newton, Natalie N., Perret, Cecile A., Knezevic, Melanie, Allen, Laura K., McNamara, Danielle S. |
| المصدر: | Grantee Submission. 2021Paper presented at ICLS (2021). |
| تمت مراجعته من قبل الزملاء: | Y |
| Page Count: | 8 |
| تاريخ النشر: | 2021 |
| Sponsoring Agency: | Institute of Education Sciences (ED) |
| Contract Number: | R305A190063 R305A180144 |
| نوع الوثيقة: | Reports - Evaluative Speeches/Meeting Papers |
| الواصفات: | Scoring Rubrics, Interrater Reliability, Design, Learning Processes, Discourse Analysis, Protocol Analysis, Educational Research |
| مستخلص: | The objective in the current paper is to examine the processes of how our research team negotiated meaning using an iterative design approach as we established, developed, and refined a rubric to capture comprehension processes and strategies evident in students' verbal protocols. The overarching project comprises multiple data sets, multiple scientists across (distant) institutions, and multiple teams of discourse analysts who are tasked with scoring over 20,000 verbal protocols (i.e., think aloud, self-explanation) collected in studies conducted in the last decade. Here, we describe the iterative modifications, negotiations, and realizations while coding our first subset comprising 7,559 individual verbal protocols. Drawing upon work in design research, we describe a process through which the research team has negotiated meaning around theory-driven codes and how this work has influenced our own ways of conceptualizing comprehension research, theory, and practice. [This paper was published in: "ICLS 2021 Proceedings," ISLS, 2021, pp. 139-146.] |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2023 |
| رقم الانضمام: | ED628198 |
| قاعدة البيانات: | ERIC |
| الوصف غير متاح. |