expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
Item 1 of 1
expired Posted by SehoneyDP • Mar 15, 2024
Mar 15, 2024 4:09 PM
NVIDIA GeForce RTX 3090 Founders Edition Dual Fan 24GB GDDR6X GPU Card (Refurb)
(Select Stores) + Free Store Pickup$700
Micro Center
Visit Micro CenterGood Deal
Bad Deal
Save
Share
Top Comments
Check out /r/localllama on reddit.
148 Comments
Sign up for a Slickdeals account to remove this ad.
The entire space is constantly changing, so like exllamav2 got an update last week to improve caching in a way that makes for more efficient vram usage, a feature that hasn't been implemented in other inference engines yet.
These things work so well, and with all the chatter on legislation on the dangers of AI, makes me think that we are a few years away from these GPUs being locked down so they can only be used for gaming. They'll make it so that the only access to AI you will have is through large companies that restrict the kinds of things you can do with them. We already see how there are export restrictions on 4090s to China. That's why there was such a jump in prices of 3090s in the past year imo.
Some people use them for 'waifus' which is a play on the word 'wife' in a specific cultural section of men who idolize Japanese culture and want a realistic fictional mate in that can conform to their specific needs.
Some people use them for D&D like ongoing roleplay adventures -- imagine having a book that is constantly written for your own tastes and that you can participate in.
Some people use them for custom solutions to problems that can't be solved any other ways.
Some people use them to recreate the personalities of people who they admire or who have passed.
Some people just don't like being told 'no' by a company when they ask their product a question and this is their way of taking control.
I mean, it is literally your own thing that can understand language and that can be molded by you to do almost infinite things that involve fluency in language.
Speaking of languages, most models become multiligual without specific training -- they just learn how languages work so even an English trained model ends up being able to translate other languages by function of its inner workings.
Sign up for a Slickdeals account to remove this ad.
I have a Razer TB3 enclosure, which I am considering installing a 3090/7900xtx on and use for AI for my laptop with TB3. (rather than in a PC directly) I want something more portable.
Curious to learn vicariously from that experience so I can either proceed or avoid doing.
Sign up for a Slickdeals account to remove this ad.
It's super efficient during idle and consumes only 3w without connect to any monitor.