expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
Item 1 of 1
expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
NVIDIA GeForce RTX 3090 Founders Edition Dual Fan 24GB GDDR6X GPU Card (Refurb)
(Select Stores) + Free Store Pickup$700
Micro Center
Visit Micro CenterGood Deal
Bad Deal
Save
Share
Top Comments
Check out /r/localllama on reddit.
148 Comments
Sign up for a Slickdeals account to remove this ad.
In GPU benchmarks, 3090 (210%) & 3090 Ti (232%) are slower than 4080 (290%) & 4090 (370%).
https://gpu.userbenchma
* For AI, 3090 Foundation Edition has 24GB VRAM = 50% more than 4080:
3090/Ti FE has 24GB VRAM (same as 4090), so they are better than 4080 (16GB) or 3080 (10GB) for AI.
I guess they were reference designs provided by Nvidia to game developers and video card OEMs for testing.
Check out /r/localllama on reddit.
Sign up for a Slickdeals account to remove this ad.
The entire space is constantly changing, so like exllamav2 got an update last week to improve caching in a way that makes for more efficient vram usage, a feature that hasn't been implemented in other inference engines yet.
These things work so well, and with all the chatter on legislation on the dangers of AI, makes me think that we are a few years away from these GPUs being locked down so they can only be used for gaming. They'll make it so that the only access to AI you will have is through large companies that restrict the kinds of things you can do with them. We already see how there are export restrictions on 4090s to China. That's why there was such a jump in prices of 3090s in the past year imo.
The entire space is constantly changing, so like exllamav2 got an update last week to improve caching in a way that makes for more efficient vram usage, a feature that hasn't been implemented in other inference engines yet.
These things work so well, and with all the chatter on legislation on the dangers of AI, makes me think that we are a few years away from these GPUs being locked down so they can only be used for gaming. They'll make it so that the only access to AI you will have is through large companies that restrict the kinds of things you can do with them. We already see how there are export restrictions on 4090s to China. That's why there was such a jump in prices of 3090s in the past year imo.
Sign up for a Slickdeals account to remove this ad.