Within-Group Agreement (r_wg(j))
HR & WorkReliability: statistical estimator4 sample items
About this scale
An interrater-agreement index used to justify aggregating individual responses to a group/unit level. Compares observed variance to expected variance under a null distribution. rwg ≥ 0.70 commonly used as threshold.
Sample item(s)
“Compute observed within-group variance s²”
“Compute expected null variance σ²_eu”
“rwg = 1 - (s² / σ²_eu)”
“rwg ≥ 0.70 supports aggregation”
Reliability
Reported internal consistency: statistical estimator. As a rule of thumb, Cronbach’s α ≥ .70 is considered acceptable, ≥ .80 good, and ≥ .90 excellent for established measures.
Notes
Standard aggregation justification.
Source & citation
James, L. R., Demaree, R. G., & Wolf, G. (1984): Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, Vol. 69, No. 1, pp. 85–98.
Source. Scale details are summarised from the publication cited above. Always consult the original source for the full item set, scoring, and permission to use.
Use it in your research
Need to check the reliability or psychometrics of this scale in your own data? Use the free DrAIStudio research tools:
Cronbach’s alpha calculator
All statistical calculators
Search the full Scale Atlas
Academic writing humanizer