EPFL researchers have developed new software – now spun-off into a start-up - that eliminates the need for data to be sent to third-party cloud services when AI is used to complete a task. This could challenge the business model of Big Tech.
A 120b parameter model is small compared to the models running in datacenters. However, this does seem like the current “Moore’s Law” for AI. Finding more and more efficient ways to run larger parameter models.
A 120b parameter model is small compared to the models running in datacenters. However, this does seem like the current “Moore’s Law” for AI. Finding more and more efficient ways to run larger parameter models.