Trials measure efficacy, but the world cares about effectiveness. Today, benchmarks lack even a good measure of efficacy and are far away from effectiveness.
把临床试验里 efficacy(理想条件有效)和 effectiveness(真实世界有用)的区分搬到评测上,是本文最可外推的一层。当前榜单连第一层都没做扎实就在谈落地,等于跳过了医学花几十年才走完的路。注意作者是 Protege 的合作方,指出问题的同时也在卖解法。