WebLLM: high-performance in-browser LLM inference engine

WebLLM is a high-performance in-browser LLM inference engine that supports various Mistral models, including Mistral-7B-v0.3, Hermes-2-Pro-Mistral-7B, NeuralHermes-2.5-Mistral-7B, and OpenHermes-2.5-Mistral-7B. It offers API support for ServiceWorker, enabling developers to integrate the generation process into a service worker. This feature helps optimize offline experiences and prevents model reloading on every page visit, enhancing efficiency for web applications.