Am I missing something? The article seems to suggest it works via hidden text characters. Has OpenAI never heard of pasting text into a utf8 notepad before?

  • CameronDev
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    4 months ago

    That is a long video, is the paper published somewhere?

    Im willing to accept that you can statistically “watermark” the text, but I’m not convinced that it would be tamper resistant, which is a large part of what makes a watermark useful. If it can’t survive an idiot with a thesaurus, its probably not gonna be terribly useful.

    • Womble@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      4 months ago

      It can likely also be defeated by adding “In the style of X” to a prompt, changing the distribution and pattern of the responses.

      • JackbyDev
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        …but that output is also from the AI so it would still be watermarked lol

        • archomrade [he/him]@midwest.social
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 months ago

          You could feed it through a different, smaller model that could even be self-hosted. It isn’t difficult to make a model that rephrases an input in another style.

          • JackbyDev
            link
            fedilink
            English
            arrow-up
            2
            ·
            4 months ago

            Ah, okay. That’s fair. It wasn’t clear they meant a different system lol.