- cross-posted to:
- machine_learning
- [email protected]
- cross-posted to:
- machine_learning
- [email protected]
Running AI models without matrix math means far less power consumption—and fewer GPUs?
Running AI models without matrix math means far less power consumption—and fewer GPUs?
Only for maximum efficiency. LLMs already run tolerably well on normal CPUs and this technique would make it much more efficient there as well.