expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
Item 1 of 4
Item 1 of 4
expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
NVIDIA GeForce RTX 3090 Founders Edition Dual Fan 24GB GDDR6X GPU Card (Refurb)
(Select Stores) + Free Store Pickup$700
Micro Center
Visit Micro CenterGood Deal
Bad Deal
Save
Share
Leave a Comment
Top Comments
Check out /r/localllama on reddit.
148 Comments
Sign up for a Slickdeals account to remove this ad.
2. Buy up all the 3090s
3. Go back 3 years and sell 3090s for $$$$$
4. Realize this is what I used my damn time machine for and smack myself
not really benefitting all that much honestly.
While that extra 8gb vram can benefit, llm are such hogs, it won't suddenly enable you to do THAT much more..
Soon, either Nvidia will have legit competition and /or llm compute will become exponentially more efficient that we will look back and laugh atb16g or 24gb ram days.
It might take a few years , but there's lots of human compute working on this every second, and I will applaud the demise of Nvidia stronghold
Sign up for a Slickdeals account to remove this ad.
Our community has rated this post as helpful. If you agree, why not thank Yukikaze
https://www.tomshardwar
Looking at these charts, it seems like the 3090 is roughly on par with the 4070 super at 1080p and 1440p. At 4k the 3090 beats the 4070 super and is roughly on par with the 4070 ti. Of course, in a game that is heavily VRAM dependent, you'll probably see a slightly smoother experience on the 3090 but only at 4k and maybe maxed out 1440p.
Personally, for gaming specifically, I'd buy either the 4070 super or 4070 ti super. You'd be using noticeably less power thus you won't need to change your current PSU (maybe you're only running say a 650w Gold?) and be roughly at the same level of performance depending on your target resolution.
But if you're looking for anything AI related, especially things like Stable Diffusion, the 24GB is the reason this is your choice. You can get ~10% faster with a 3080Ti refurb, but you're really getting a SIGNIFICANT multiplier to how long any generation takes any time your VRAM becomes the limiting factor. The 24GB of VRAM is the most available, so you're eliminating VRAM limitations as much as you can with a consumer level card once you're at 24GB.
Combinations of higher resolutions, upscaling, LoRAs and ControlNet will make extra VRAM critical. You need a minimum of 16GB to train locally as well.
If you want gaming performance and a warranty, a new 4000 series makes more sense. If you want 24GB of VRAM and Nvidia, this is the cheapest entry available.
The price increase and performance increase at 768x768 generation is almost the same percentage between the 3090 and 3090 Ti at MicroCenter, so the 3090 Ti also makes sense if you've got the extra $100 and want the extra speed.
The 4090 is roughly 250% more, so unless you already knew you wanted a $2,000 card, the 3090 and 3090Ti are the only real decision to make for someone looking for 24GB VRAM.
For gaming there are AMD 6950XT, 7900GRE, 7800XT that are cheaper and have similar performance with the exception of ray tracing.
Like many others have said, picking up a 4070 ti or ti super is a better idea.
Sign up for a Slickdeals account to remove this ad.
https://ollama.com/blog/amd-preview
So the question becomes is it better to buy a refurbished 3090 or get a new 7900 xtx with the same ram for a similar price?
If you are just looking to use LLMs an argument can be made the 7900 XTX Is a better investment, but if you're looking to use it predominantly for image generation, such as stable diffusion, then the Nvidia card is better.
Leave a Comment