Chrome's new LLM AI API OMG

Off The Main Thread

Chrome is experimenting with exposing an LLM to the web platform. Jake and Surma dig into how the API works, and whether something like this could work on the open web.

Resources:

• The explainer
• ChatGPT functions
• Chrome's initial vague docs about the feature
• Gemini terms of use
• The EURion constellation
• WebNN