Back
RCreddit.com

My only real use case for a local AI use is document management, how much VRAM do I realistically need for a good experience?

View original
On-device
Time & source
Published
09/05, 23:44
Ingested
09/06, 16:00
Source type
Dev community
Tier
Community
Source status
Healthy
Tier is a per-source editorial setting, not a per-item score.

I just want to use paperless-ai and be able to ask questions relative to it. Bonus points if I could use it with home assistant but that's not the focus.

I just can't see needing a 32 GB VRAM GPU for just that, but I don't want to buy a GPU only to find out that "yeah, it's technically feasible but not a good user experience"

The GPU's I tend to find at good prices are in the 8-12 GB range, would my use case be a good one to just get a 12 GB and run a 6-10 gb model?