ylai@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 9 months agoMistral CEO confirms ‘leak’ of new open source AI model nearing GPT-4 performanceventurebeat.comexternal-linkmessage-square8fedilinkarrow-up142arrow-down12cross-posted to: [email protected][email protected][email protected]
arrow-up140arrow-down1external-linkMistral CEO confirms ‘leak’ of new open source AI model nearing GPT-4 performanceventurebeat.comylai@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 9 months agomessage-square8fedilinkcross-posted to: [email protected][email protected][email protected]
minus-squareffhein@lemmy.worldlinkfedilinkEnglisharrow-up1·8 months agoGGUF q2_K works quite well IMO, I’ve run it with 12GB vram + 32GB ram
GGUF q2_K works quite well IMO, I’ve run it with 12GB vram + 32GB ram