A language model in your browser, accessible as a Web API?
July 10, 2024
AI, these days, is all about cloud services. You chat with a bot, you ask a voice assistant for something, etc. All of which happens to be powered by some AI model that’s running on a server somewhere. But on-device AI is a thing too. It’s just maybe less popular, less well-known. On-device AI refers to running AI models on the same device where the user is consuming the result of the model.
Source: A language model in your browser, accessible as a Web API?
