• suoko@feddit.it
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Do we have any llama apk/deb/flatpack/appimage where you just choose the llm to use?

      • gens
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Idk if GPT4All is what you want.

      • ddx7@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        lamacpp is kind of this. you give it a path to a model and a prompt. download a smallish model GGUF file by thebloke. lamacpp main exec has an interactive mode too which can function like a chatbot. i never built it on android though maybe you need android NDK