I've found myself using Local LLM's like 3D printers.
- 发布
- 09/05 07:03
- 收录
- 09/05 11:00
- 来源类型
- 开发者社区
- 档位
- 社区
- 信源状态
- 正常
讨论趋势
百分比基于采集到的讨论信号，不代表新增评论数或独立参与人数。曲线仅用于同一话题在不同时段的比较。
用户们将本地大型语言模型（LLMs）比作3D打印机，认为它们在处理各种任务时极其有用。一位用户提到，他们曾将Qwen 3.6 27B或3.6 35B moe与本地LLM配对，现在则使用3.8 27B uncensored版本，该版本能够轻松处理Q8模型并支持完整的256k上下文。本地LLMs的优势在于，即使它们速度较慢，用户也可以在24小时内处理5000万个token来探索新想法或解决问题，而所需成本仅为少量的电力和时间。
Anyone who has a 3D printer and get use of it finds it incredibly useful for those odd jobs around the house, a missing bracket, a cable router, steam deck holder and so on.
In the past if I was missing an app or useful software, a game I'd do the lazy thing, even though I can and have coded in the past, its "effort" I'll just go and buy or download the latest and greatest.
Earlier in the year I was lucky to snag a Minisforum MS-S1 395+ Max with 128GB Unified memory (currently setup 32gb system and 96gb Vram) before the price hike.
Was paired with a Qwen 3.6 27B or 3.6 35B moe but now a 3.8 27B uncensored. it can easily handle a Q8 with full 256k context.
Its now become my first instinct when I'm missing software to build it in a couple of hours local using the custom agent framework I setup.
Nothing I've created is for external use but every single day I find myself adding to it, while writing this post for example my framework finished an idea I had 2 hours ago when, I woke up this morning thinking I've got a lot of japanese visual novels and why don't I just design a combination hook into Exe or ocr the text app that translates via a local llm, and its done, ready for me to test.
I've written 12 adult games (don't code horny) a house AI, a coding framework, a game app to keep a track of all the games I play and download any faq or wiki to do with said game, 17 mods for my Skyrim install, 12 for my Fallout New vegas install, A temperature tracking system for the house that pulls rss local feeds and makes suggestions for my central heating system temps settings, A mapping software for my mobility scooter that checks my normal routes for issues and street work or maintenance that could make pavements impassable.
Plus hundreds of tweaks and test programs.
Anyone else out there using it like this?
---------Update-----
Awesome to see this kind of discourse one of the amazing strengths of these local llm's is it doesn't matter if they are slower, I can burn 50 million tokens over a 24 hours period on a new idea or problem and all it costs me is a little bit of electricity and time.