Chrome’s new LLM AI API OMG
September 11, 2024
Chrome is experimenting with exposing an LLM to the web platform. Jake and Surma dig into how the API works, and whether something like this could work on the open web.
We’ve looked a little recently at efforts to bring large language model inference into the browser. Here listen (or read the transcript) to details about Google’s proposed Prompt API, a DOM API that would give JavaScript developers access to a large language model locally, in the browser.