Study: Shorter lists make people misjudge rankings
Researchers have found that people tend to misinterpret rankings when presented with different list lengths, even when the relative positions are equivalent. The study highlights how cognitive biases can affect decision-making in professional contexts. For instance, when choosing between two employees for a director-level promotion at a Big 4 firm, one candidate might be ranked third out of 12, while another is ranked sixth out of 24. Although both candidates occupy the same relative position within their respective teams – the top quarter – and have outperformed three-fourths of their peers, the shorter list (third out of 12) may be perceived more favorably due to psychological factors.
This research illuminates a common cognitive bias where the absolute number in a ranking, rather than the relative position, unduly influences perception. In professional settings, such biases can lead to suboptimal talent allocation, as decision-makers may favor candidates from shorter, seemingly more competitive lists, irrespective of equivalent performance metrics. This suggests a need for standardized evaluation frameworks that mitigate such perceptual distortions, particularly in high-stakes decisions like promotions. Over the next decade, as AI increasingly assists in performance analysis, understanding and correcting these human cognitive pitfalls will be crucial for ensuring fairness and maximizing organizational effectiveness.
AI-generated to prompt reflection — not editorial opinion, not advice, not a statement of fact. How this works.