跳到正文
RCreddit.com·
暂不在当前实时榜单

Qwen3.8-Flash-Next, on 5090+64gb, with Llama.cpp - Seems to not use ram?

AI 摘要

A user is experimenting with Qwen3.8-Flash-Next on a system with a 5090 GPU and 64GB RAM, using Llama.cpp. They are curious about the Flash-Next version's performance, especially since it doesn't require the entire model to fit into VRAM. The user is running the model with specific parameters, including --gpu-layers all, --ctx-size 64768, and --flash-attn on. They are surprised by the speed, which is better than expected, but suspect they might be missing something regarding RAM usage.

时间与来源

时间显示为 UTC

显示时区:UTC

本地时区尚不可用,暂时显示 UTC。

收录当时偏移:UTC+02026年9月25日 16:02 UTC

收录
2026年9月25日 16:02
来源类型
开发者社区

本站未收录正文。

前往源站阅读 →
来源·reddit.com