eLife Assessment
This important work outlines why commonly applied performance metrics in predictive modelling do not accurately reflect translational potential using the example of psychiatric care; it provides a web-based tool to contextualize effect sizes in psychiatry with respect to reliability and base rates, and to calculate the real-world utility of prediction models under different scenarios. The evidence supporting the conclusions is convincing, incorporating established psychometric principles that will be of use for multiple fields, along with transparent quantitative logic and example applications. The manuscript would benefit from further details about how the tool can be optimally applied and how the resulting outputs should be interpreted. The work will be of broad interest to both clinical experts and scientists in biomedicine and the life sciences.