WebNN Developer Preview

July 12, 2024

Run ONNX models in the browser with WebNN. The developer preview unlocks interactive ML on the web that benefits from reduced latency, enhanced privacy and security, and GPU acceleration from DirectML

Source: WebNN Developer Preview

Google recently announced and experimental API for running their language model Gemini Nano in the browser. WebNN (Web Neural Networks) is an emerging standard for running models in the browser. We’ve co eyed it a couple of times in our conferences (including a dedicated session way back in 2021, we like to stay ahead of the curve).

This project allows you to relatively easily run models popular like Stable Diffusion (for image generation) and whisper (speech recognition) in the browser.