Help With Choosing Hardware [P]
A user is seeking hardware recommendations to fine-tune a satire model based on Qwen3.5-14B-Base. The dataset contains approximately 18,000 examples, many of which are lengthy and contain factual inaccuracies, necessitating a full fine-tune rather than using LoRA. The user is asking for advice on suitable hardware for this task.
Time & source
Times shown in UTC
Display time zone: UTC
Local time zone unavailable; showing UTC.
PublishedOffset at this time: UTC+0Oct 10, 2026, 08:00 UTC
IngestedOffset at this time: UTC+0Oct 10, 2026, 13:00 UTC
- Published
- Oct 10, 2026, 08:00
- Ingested
- Oct 10, 2026, 13:00
- Source type
- Dev community
- Tier
- Community
- Source status
- Sync delayed
Tier is a per-source editorial setting, not a per-item score.
I am going to fine-tune a satire model, with the base model being Qwen3.5-14B-Base. The dataset has ~18000 examples, most of which are pretty long and do not align with the model's internal knowledge (they have incorrect answers to facts), so I needed to do a full fine tune rather than use LoRA.
Today, I rented a cloud computer on vast.ai. It had 4x12GB GPUs and 48GB of system RAM, but I feel stupid because it kept running out of memory when I tried training, and I kept trying to change settings rather than just renting a different computer, so I basically wasted $3. I underestimated how much RAM would be needed for this task.
So, I would like to know if any of you have some recommendations for proper hardware to use.