A Quick Look at AI in Chrome

August 30, 2024

Google announced a while back their intent to experiment with generative AI in the browser itself. Personally, I think this could be a really good idea, but I’m really unsure as to how many other vendors would support it. With Edge being a Chromium product, and Microsoft being pro-GenAI, it seems like a safe bet it would support it. Safari and Firefox… I honestly feel like they probably never would. That being said, initial support landed in Chrome Canary (the bleeding edge version of Chrome) and I thought I’d take a quick look. Here’s what I found.

Source: A Quick Look at AI in Chrome

Recently we’ve seen iOS and Android announce AI focussed platform APIs. These enable inference on the device, making for more responsive (no roundtrip to server) and less expensive (no tokens to purchase from the likes of OpenAI) and a whole class of applications that might otherwise be unfeasible.

But what’s the Web’s story? Google recently announced an API for a model in the browser (and an associated proposal for a standardised prompt API in the browser).

Here Raymond Camden takes it for a spin.

Watch this space.