codeinabox to AI - Artificial intelligenceEnglish · 2 months agoExperimenting with local LLMs on macOSblog.6nok.orgexternal-linkmessage-square4linkfedilinkarrow-up13arrow-down11cross-posted to: [email protected]
arrow-up12arrow-down1external-linkExperimenting with local LLMs on macOSblog.6nok.orgcodeinabox to AI - Artificial intelligenceEnglish · 2 months agomessage-square4linkfedilinkcross-posted to: [email protected]
minus-squarecodeinaboxOPlinkfedilinkEnglisharrow-up2·1 month agoOllama uses the Metal API on Apple Silicon Macs for GPU acceleration.
minus-squareonlinepersonalinkfedilinkEnglisharrow-up1·1 month agoInteresting. Is that similar to Vulkan?
minus-squarecodeinaboxOPlinkfedilinkEnglisharrow-up3·1 month ago Vulkan? I’m not too familiar with either, but this article goes into more detail: A Comparison of Modern Graphics APIs
Ollama uses the Metal API on Apple Silicon Macs for GPU acceleration.
Interesting. Is that similar to Vulkan?
I’m not too familiar with either, but this article goes into more detail: A Comparison of Modern Graphics APIs