• Retro_unlimited@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    1 month ago

    I self host several free AI models, one of them I run using a program called “gpt4all” that lets you run several models locally.

    • Scoopta
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      edit-2
      1 month ago

      Ollama is also a cool way of running multiple models locally

      • Retro_unlimited@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 month ago

        That might be the other one I run, I forget because it’s on my server as a virtual machine (rtx 3080 pass through), but I haven’t used it in a long time.