دورية أكاديمية
Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings
| العنوان: | Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings |
|---|---|
| المؤلفون: | Jackson, Duncan, Michaelides, George, Dewberry, Chris, Jones, Amanda, Toms, Simon, Schwenke, Benjamin, Yang, Wei-Ning |
| سنة النشر: | 2022 |
| المجموعة: | University of East Anglia: UEA Digital Repository |
| الوصف: | We modeled the effects commonly described as defining the measurement structure of supervisor performance ratings. In doing so, we contribute to different theoretical perspectives, including components of the multifactor and mediated models of performance ratings. Across two reanalyzed samples (Sample 1, N ratees = 392, N raters = 244; Sample 2, N ratees = 342, N raters = 397), we found a structure primarily reflective of general (>27% of variance explained) and rater-related (>49%) effects, with relatively small performance dimension effects (between 1% and 11%). We drew on findings from the assessment center literature to approximate the proportion of rater variance that might theoretically contribute to reliability in performance ratings. We found that even moderate contributions of rater-related variance to reliability resulted in a sizable impact on reliability estimates, drawing them closer to accepted criteria. |
| نوع الوثيقة: | article in journal/newspaper |
| وصف الملف: | application/pdf |
| اللغة: | English |
| العلاقة: | https://ueaeprints.uea.ac.uk/id/eprint/87080/1/MSS_Supervisor_Performance_Ratings_Accepted.pdfTest; Jackson, Duncan, Michaelides, George, Dewberry, Chris, Jones, Amanda, Toms, Simon, Schwenke, Benjamin and Yang, Wei-Ning (2022) Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings. Human Performance, 35 (3-4). pp. 278-301. ISSN 0895-9285 |
| DOI: | 10.1080/08959285.2022.2111433 |
| الإتاحة: | https://doi.org/10.1080/08959285.2022.2111433Test https://ueaeprints.uea.ac.uk/id/eprint/87080Test/ https://ueaeprints.uea.ac.uk/id/eprint/87080/1/MSS_Supervisor_Performance_Ratings_Accepted.pdfTest |
| حقوق: | cc_by |
| رقم الانضمام: | edsbas.85FEF154 |
| قاعدة البيانات: | BASE |
| ResultId |
1 |
|---|---|
| Header |
edsbas BASE edsbas.85FEF154 947 3 Academic Journal academicJournal 947.047973632813 |
| PLink |
https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&scope=site&db=edsbas&AN=edsbas.85FEF154&custid=s6537998&authtype=sso |
| FullText |
Array
(
[Availability] => 0
)
Array ( [0] => Array ( [Url] => https://doi.org/10.1080/08959285.2022.2111433# [Name] => EDS - BASE [Category] => fullText [Text] => View record in BASE [MouseOverText] => View record in BASE ) ) |
| Items |
Array
(
[Name] => Title
[Label] => Title
[Group] => Ti
[Data] => Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings
)
Array ( [Name] => Author [Label] => Authors [Group] => Au [Data] => <searchLink fieldCode="AR" term="%22Jackson%2C+Duncan%22">Jackson, Duncan</searchLink><br /><searchLink fieldCode="AR" term="%22Michaelides%2C+George%22">Michaelides, George</searchLink><br /><searchLink fieldCode="AR" term="%22Dewberry%2C+Chris%22">Dewberry, Chris</searchLink><br /><searchLink fieldCode="AR" term="%22Jones%2C+Amanda%22">Jones, Amanda</searchLink><br /><searchLink fieldCode="AR" term="%22Toms%2C+Simon%22">Toms, Simon</searchLink><br /><searchLink fieldCode="AR" term="%22Schwenke%2C+Benjamin%22">Schwenke, Benjamin</searchLink><br /><searchLink fieldCode="AR" term="%22Yang%2C+Wei-Ning%22">Yang, Wei-Ning</searchLink> ) Array ( [Name] => DatePubCY [Label] => Publication Year [Group] => Date [Data] => 2022 ) Array ( [Name] => Subset [Label] => Collection [Group] => HoldingsInfo [Data] => University of East Anglia: UEA Digital Repository ) Array ( [Name] => Abstract [Label] => Description [Group] => Ab [Data] => We modeled the effects commonly described as defining the measurement structure of supervisor performance ratings. In doing so, we contribute to different theoretical perspectives, including components of the multifactor and mediated models of performance ratings. Across two reanalyzed samples (Sample 1, N ratees = 392, N raters = 244; Sample 2, N ratees = 342, N raters = 397), we found a structure primarily reflective of general (>27% of variance explained) and rater-related (>49%) effects, with relatively small performance dimension effects (between 1% and 11%). We drew on findings from the assessment center literature to approximate the proportion of rater variance that might theoretically contribute to reliability in performance ratings. We found that even moderate contributions of rater-related variance to reliability resulted in a sizable impact on reliability estimates, drawing them closer to accepted criteria. ) Array ( [Name] => TypeDocument [Label] => Document Type [Group] => TypDoc [Data] => article in journal/newspaper ) Array ( [Name] => Format [Label] => File Description [Group] => SrcInfo [Data] => application/pdf ) Array ( [Name] => Language [Label] => Language [Group] => Lang [Data] => English ) Array ( [Name] => NoteTitleSource [Label] => Relation [Group] => SrcInfo [Data] => https://ueaeprints.uea.ac.uk/id/eprint/87080/1/MSS_Supervisor_Performance_Ratings_Accepted.pdf; Jackson, Duncan, Michaelides, George, Dewberry, Chris, Jones, Amanda, Toms, Simon, Schwenke, Benjamin and Yang, Wei-Ning (2022) Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings. Human Performance, 35 (3-4). pp. 278-301. ISSN 0895-9285 ) Array ( [Name] => DOI [Label] => DOI [Group] => ID [Data] => 10.1080/08959285.2022.2111433 ) Array ( [Name] => URL [Label] => Availability [Group] => URL [Data] => https://doi.org/10.1080/08959285.2022.2111433<br />https://ueaeprints.uea.ac.uk/id/eprint/87080/<br />https://ueaeprints.uea.ac.uk/id/eprint/87080/1/MSS_Supervisor_Performance_Ratings_Accepted.pdf ) Array ( [Name] => Copyright [Label] => Rights [Group] => Cpyrght [Data] => cc_by ) Array ( [Name] => AN [Label] => Accession Number [Group] => ID [Data] => edsbas.85FEF154 ) |
| RecordInfo |
Array
(
[BibEntity] => Array
(
[Identifiers] => Array
(
[0] => Array
(
[Type] => doi
[Value] => 10.1080/08959285.2022.2111433
)
)
[Languages] => Array
(
[0] => Array
(
[Text] => English
)
)
[Titles] => Array
(
[0] => Array
(
[TitleFull] => Uncertainty about rater variance and small dimension effects impact reliability in supervisor ratings
[Type] => main
)
)
)
[BibRelationships] => Array
(
[HasContributorRelationships] => Array
(
[0] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Jackson, Duncan
)
)
)
[1] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Michaelides, George
)
)
)
[2] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Dewberry, Chris
)
)
)
[3] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Jones, Amanda
)
)
)
[4] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Toms, Simon
)
)
)
[5] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Schwenke, Benjamin
)
)
)
[6] => Array
(
[PersonEntity] => Array
(
[Name] => Array
(
[NameFull] => Yang, Wei-Ning
)
)
)
)
[IsPartOfRelationships] => Array
(
[0] => Array
(
[BibEntity] => Array
(
[Dates] => Array
(
[0] => Array
(
[D] => 01
[M] => 01
[Type] => published
[Y] => 2022
)
)
[Identifiers] => Array
(
[0] => Array
(
[Type] => issn-locals
[Value] => edsbas
)
[1] => Array
(
[Type] => issn-locals
[Value] => edsbas.oa
)
)
)
)
)
)
)
|
| IllustrationInfo |