Purge everything first, then install latest driver from distro repo, last the toolkit from nvidia repo.
GeForce 210 October 12, 2009 GT218 40 260 57 PCIe 2.0 x16
PCIe x1
PCI 16:8:4 520
589 1230
1402 1000โ1600 2.356 4.712 512
1024 4.0
8.0
12.8 DDR2
DDR3 32
64 10.1 3.3 67.296 30.5
How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.