15 Matching Annotations
  1. Last 7 days
    1. go back to the original data, tabulate the distribution of performances at each age,

      Question 5: How could the authors have addressed fairness and relevance?

      The authors could have addressed fairness by acknowledging the limitations of their original graphs and considering alternative explanations, including differences in sample sizes and participation across age groups. Rather than assuming aging explains every difference, they could have examined evidence that might challenge their interpretation.

      To address relevance, they could have compared performance distributions across age groups and included research that directly examines physical changes associated with aging. This would help separate the effects of aging from differences in participation and provide stronger evidence for their conclusion. The author’s willingness to recognize these limitations demonstrates the importance of evaluating evidence fairly.

    2. The curves plotted in these graphs do not represent the performance of any single individual.

      Question 4: How is the logic intellectual standard violated here?

      The logic standard is violated because the graphs compare world records set by different athletes at different ages rather than following the same individuals over time. The reasoning assumes that these differences accurately represent how a person’s physical performance declines with age. However, the evidence does not directly establish that conclusion. Other factors, including differences in participation and sample sizes, could influence the results. Therefore, the conclusion goes beyond what these particular data logically support.

    3. "The problem with that graph is that the sample sizes are very different for different ages,"

      Question 3: How is the completeness intellectual standard violated here?

      The completeness standard is violated because the original graphs leave out important information needed to evaluate the conclusion. They do not account for the differences in the number of athletes competing at each age or explain how smaller sample sizes could affect world records. Without considering these factors, the evidence does not provide a complete explanation of why athletic performance appears to decline with age.

    4. if it happens to the very best athletes in the world, of course it'll happen to you and me

      Question 2: How does this case use inductive reasoning?

      The author uses specific observations of declining athletic world records to support a broader conclusion that physical performance decreases as people age. This is inductive reasoning because the conclusion is based on patterns in the evidence rather than absolute proof. Although the records suggest a relationship between aging and physical decline, they do not establish how every individual experiences aging or prove that age alone explains the differences.

    5. The graphs represent the extremes of human performance.

      Question 1: What are two problems with the sample?

      The first problem is that the sample includes only elite athletes who represent the extremes of human performance, not the general population. Their results cannot accurately represent how everyone experiences physical aging.

      The second problem is that sample sizes differ significantly between age groups. Far fewer older athletes compete, which means declining world records could partly reflect fewer participants rather than aging alone. These limitations weaken the conclusion drawn from the data.

  2. Oct 2026
    1. The authors have confused facial features with facial expressions.

      The input consists of facial photographs labeled as criminal or noncriminal. The output is the algorithm's prediction of which category a person belongs to. I believe the input is more problematic because the photographs were collected under different circumstances and may contain biases. The algorithm could be identifying differences in facial expressions rather than criminal behavior. If the information used to train an algorithm is flawed, its predictions may be misleading even when the algorithm processes that information correctly.

    2. Each introduces major biases of precisely the sort that the authors claim are avoided by machine learning algorithms.

      I believe this violates the intellectual standard of fairness because the researchers did not account for the different circumstances under which the photographs were obtained. The noncriminal photographs came from websites where individuals were likely presented favorably, while the criminal photographs came from police sources. These differences could influence how people appeared in the photographs. If the algorithm was recognizing differences in facial expressions rather than criminal behavior, the comparison would not be fair. Researchers need to consider these possibilities before drawing conclusions about individuals.

    3. A machine learning algorithm can be only as good, and only as unbiased, as the training data that we provide to it.

      Wu and Zhang's reasoning overlooks the fact that a computer can learn biases from the data people provide. Their photographs of noncriminals came from websites, while the photographs of convicted individuals came from police sources. These different circumstances could influence facial expressions and how people appeared in the pictures. Even if the algorithm processes information without personal emotions, its results may still reflect human biases in how the data was collected and labeled. Using a computer does not automatically make a study objective.

    4. Moreover, they argue that their computer algorithms are free from the myriad biases and prejudices that cloud human judgment:

      Wu and Zhang argued that their computer algorithms were not influenced by human prejudices involving race, religion, gender, or personal experiences. They believed that because a computer does not have human emotions or personal beliefs, it could evaluate facial photographs objectively. They also limited their sample to Chinese men, reducing some demographic differences between the groups. However, these precautions do not necessarily eliminate biases already present in the information used to train the algorithm.

    5. He proposed that criminals were born as such, and that they exhibit both psychological drives and physical features that harken back to what were, in his view, the subhuman beasts of our deep evolutionary past

      I believe sociocentricity best describes the foundation of Lombroso's theory. He associated certain physical characteristics with criminal behavior and treated those traits as evidence about a person's character. Rather than evaluating individuals based on their actual actions, his theory relied on assumptions about groups of people. This reflects group-centered thinking and violates the intellectual standard of fairness because it judges individuals through stereotypes rather than reliable evidence.

    1. We suspect the most likely explanation for their findings is that untrained humans are poor at integrating multiple cues to make good probabilistic estimates, and that sexual orientation influences grooming and self-presentation.

      The researchers could have improved fairness by giving human participants training and practice comparable to what the computer algorithm received before comparing their performance. They could have improved relevance by directly testing their biological explanation and considering other factors that might influence the photographs, such as grooming, lighting, and personal presentation. They also needed to distinguish between what the algorithm could predict and what those predictions actually proved. These changes would have made their conclusions more balanced and better supported by evidence.

    2. If a test doesn't put a hypothesis on the line, results that are merely consistent with the hypothesis don't offer strong evidence in its favor.

      The relevance intellectual standard is violated because the researchers used patterns found in facial photographs to support a theory about prenatal hormone exposure. However, the study did not directly test that theory. Other factors, including genetics, grooming, and how people present themselves in photographs, could explain the patterns. Evidence that is consistent with a theory does not necessarily prove that theory is correct. The researchers needed evidence more directly relevant to their proposed explanation.

    3. While the results are consistent with this claim, they do not come anywhere near demonstrating it. Indeed, there is a more parsimonious explanation for why the neural net outperforms humans at this classification task: it's not a fair contest.

      The fairness intellectual standard is violated because the researchers compared a computer algorithm trained on thousands of photographs with human participants who had not received similar training. This creates an unequal comparison. Concluding that computers can recognize characteristics humans cannot overlooks the differences in their preparation. A fair comparison should account for those differences before drawing conclusions about human abilities.

    4. The central theme of our Calling Bullshit course is you don't always need to understand the technical details of a statistical analysis or computer algorithm to call bullshit on its use.

      We don't always need advanced technical knowledge to question an algorithm because we can examine the information being entered and whether the conclusions are reasonable. Even if the calculations are correct, the results can be misleading when the data is biased or the conclusions go beyond what the evidence supports. Critical thinking means questioning assumptions and considering alternative explanations rather than accepting a claim simply because it involves sophisticated technology.

    5. First, they assemble data that they use as inputs. Second, they feed these data into some the analytic machinery, represented below by the black box

      A statistical analysis or computer algorithm generally follows four steps. First, data is collected as the input. Second, that data is processed through an algorithm or statistical method. Third, the process produces results. Finally, those results are interpreted and may be used to support a conclusion or decision. Each step matters because even a correctly functioning algorithm can produce misleading conclusions if the data or interpretation is flawed.