6 Matching Annotations
  1. Apr 2026
    1. Writing code and calling tools are almost the same thing, but it seems like LLMs can do one much better than the other?

      I lost them about there.

      Ask the LLM to write code but then run it how exactly?

    2. except that the user cannot produce these special tokens

      Cannot is odd here. Technically there is nothing stopping the user from 'producing' these tokens.

    3. Note that here we've used words in <| and |> to represent our special tokens, but in fact, these tokens do not represent text at all; this is just for illustration.
      • To the best of my understanding, what they are saying is that this is in the vector space i.e. the 'tool call' tokens are special things in the token space.