• Hexarei
    link
    fedilink
    arrow-up
    6
    arrow-down
    3
    ·
    1 year ago

    Except they can absolutely come up with new things; their responses aren’t just cut and pasted bites of previous text snippets. They are generated based on a neural network’s idea of what the most likely next token is, and tokens are often fragments of words. There’s a reason you can have it do arbitrary things with text- Because it’s doing slightly deeper things than just imitation.