llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) by ngxson · Pull Request #29818 · ggml-org/llama.cpp

A new /v1/systemone API has been added to the llama server in ggml-org/llama.cpp, as detailed in Pull Request #29818. This API supports models such as laya, julia-1, lev, openjev, and kev. The development is further highlighted by a blog post on Hugging Face discussing decision models in llama.cpp, and links to various GGUF models like OpenJev-GGUF and Bespoke-Nimble-9B-v3-GGUF are provided.

This update introduces a new API for llama.cpp, unlike previous versions that lacked a dedicated systemone API for these specific models.