llama.cpp

查看原文

Llama

llama

热度趋势

趋势数据积累中

百分比基于当前可用热度信号，而非评论数或独立用户人数。

推荐理由

这条记录涉及编程工具或代码能力更新，适合开发者评估工作流变化和可复用价值。

Pair it with a local coding agent.

Run llama serve, install the pi-llama plugin and launch Pi. It will automatically discover your local model. No config, no API keys. Files stay on your machine, requests never leave it.

# 1. Serve a model llama serve

# 2. Install the pi-llama plugin pi install git:github.com/huggingface/pi-llama

# 3. Run Pi, everything is set pi

Optimized for any hardware.

From your laptop to a cluster, llama.cpp runs on whatever you have. Same binary, same models, same hand-tuned kernels for every GPU and CPU.

Apple Silicon

M Ultra

RTX 5090

CPU

Jetson

H100

MI300

RTX 4090

A100

M Pro

M Max

DGX Spark

Radeon RX

B200

Intel Arc

RTX 3090