Purge everything first, then install latest driver from distro repo, last the toolkit from nvidia repo.
How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.
GeForce 210 October 12, 2009 GT218 40 260 57 PCIe 2.0 x16
PCIe x1
PCI 16:8:4 520
589 1230
1402 1000โ1600 2.356 4.712 512
1024 4.0
8.0
12.8 DDR2
DDR3 32
64 10.1 3.3 67.296 30.5