Ideal setup for dual 4090 : r/LocalLLaMA
I''m building a dual 4090 setup for local genAI experiments. The goal is a reasonable configuration for running LLMs, like a quantized 70B llama2, or multiple smaller models in a crude Mixture of Experts
Get Quote