Often several different individuals make judgments about a person.
Human judgement can be messy. Inter-rater reliability is important because it separates an objective workplace from bias. The goal is to see if candidates are skilled rather then having to have chosen the correct answer. The generalizability theory helps calculate the candidates answers along with the toughness of the raters and the test conditions. What should companies do differently if they see low numbers consistently?