Reusing old hardware for starting local ai-journey?

端侧推理

时间与来源

发布: 09/05 09:53
收录: 09/05 20:00
来源类型: 开发者社区
档位: 社区
信源状态: 正常

AI 摘要

一位用户正考虑利用旧硬件开启本地AI学习之旅，主要用于聊天机器人、代理系统和RAG等任务。他们手头有三台NUC11（配备Core i5 1145G7处理器、64GB DDR4 2666MHZ内存）以及一台搭载Ryzen 3700x处理器、64GB DDR4 2133内存和一块旧SAPPHIRE Nitro+ Radeon RX 590 8GB显卡的系统。用户初步设想是在Ryzen系统中添加一块RTX5060TI或R9700显卡，并利用Radeon显卡进行显示输出，目前正在寻求其他建议。

Hi,

I am thinking about putting some money / time into my local ai learning path and "cleared" my attic where I found the following hardware.

- 3 x NUC11 (Core i5 1145G7 / 2,6 GHz, 64 GB RAM DDR4 2666MHZ - SODIMM) with interconnect through Thunderbolt

- 1x Ryzen 3700x on MSI Mortar 350 with 64GB RAM DDR4 2133 and an old SAPPHIRE Nitro+ Radeon RX 590 8GB

My first idea was to purchase a single RTX5060TI / R9700 and put it into the PCIe 3.0 x16 slot while reusing the Radeon as GPU in the PCIe 2.0 slot for Display.

I want to play around with a local chat bot, agentic stuff, RAG...

Do you have any other ideas? I also though about putting some serious money, but for this discussion I probably open a new thread (this could be a 2-step-path where I reuse the GPU above to built a multi-gpu-rig)