• ramirezmike
    link
    fedilink
    arrow-up
    1
    ·
    7 months ago

    doesn’t it work literally by passing in everything it said to determine what the next word is?

    • adderaline@beehaw.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      7 months ago

      it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.