However, in the case of LLMs, such istheir power, things can get a little blurry. Whenan LLM can be made to improve its performanceon reasoning tasks simply by being told to “thinkstep by step” (Kojima et al., 2022) (to pick justone remarkable discovery), the temptation to seeit as having human-like characteristics is almostoverwhelming.
Intentional stance meets uncanny valley
Intentional stance language becomes problematic when we can no longer distinguish the inanimate object's behavior from human behavior.