This collaborative space allows users to contribute additional information, tips, and insights to enhance the original deal post. Feel free to share your knowledge and help fellow shoppers make informed decisions.
Good for local LLMs? 8GB may be the choking point but would need some inputs from others.
on the RTX card - Can run small models, 6GB I think. 7GB not sure if it will even fit on the graphics card depending no some factors Guess but 8GB is pretty limited. You can use, some people can even run images on 8GB or video every but it would be slow....
If you are gonna really play with LLM, you will outgrow 8GB very quickly.
BUT Ryzen AI chip also has unified memory -- this one should too so you can allocate more to the system ram at like 75-80% system ram capacity to run LLM. Again, not fast but will run. 32GB system ram is like 24GB of a VRAM if you shift it for LLM use.
24GB laptop is a 5090 laptop (not as fast but can hold same size llm).
Anyway, 5090 laptop is about 75 tgs/s on 24GB 5090 laptop, I think this machine I am guessing without the math is probably gonna be around 20-35 tgs for 32B Moe Model which may be good enough for you.
You can LLM text on Ryzen and pump out images on the RTX card on this machine simultaneously I guess.
good compromise for low to mid performance? I don't own a Ryzen to know the practical day to day use and speed though...
Join The Conversation
Share your experience with the Slickdeals community
Share information with the community. Please follow our Community Guidelines and be kind!
5 Comments
Sign up for a Slickdeals account to remove this ad.
If you are gonna really play with LLM, you will outgrow 8GB very quickly.
BUT Ryzen AI chip also has unified memory -- this one should too so you can allocate more to the system ram at like 75-80% system ram capacity to run LLM. Again, not fast but will run. 32GB system ram is like 24GB of a VRAM if you shift it for LLM use.
24GB laptop is a 5090 laptop (not as fast but can hold same size llm).
Anyway, 5090 laptop is about 75 tgs/s on 24GB 5090 laptop, I think this machine I am guessing without the math is probably gonna be around 20-35 tgs for 32B Moe Model which may be good enough for you.
You can LLM text on Ryzen and pump out images on the RTX card on this machine simultaneously I guess.
good compromise for low to mid performance? I don't own a Ryzen to know the practical day to day use and speed though...
Join The Conversation
Share your experience with the Slickdeals community
Share information with the community. Please follow our Community Guidelines and be kind!