GMKtec EVO-X1 MFF AI Mini PC: Ryzen AI 9 HX 370, 32GB LPDDR5x, 2TB SSD, OCulink $699.99

jasoncwlee

Today 04:41 AM

421 Posts

Joined Feb 2008

jasoncwleeToday 04:41 AM

421 Posts

Is this good for running AI model locally using unified memory?

Dr.W

Original Poster

Pro

Today 05:08 AM

11,199 Posts

Joined Nov 2020

Dr.W

Original Poster

Pro

Today 05:08 AM

11,199 Posts

Quote from jasoncwlee

:

Is this good for running AI model locally using unified memory?

Yes, it's a very good choice to locally run AI models if you optimize (use quantization, efficient frameworks, keep models reasonable in size). It's especially good for inference, testing, and lighter workloads. For large models or many simultaneous sessions, a discrete GPU rig might do more, but this is solid for what many users want locally.

3

insaneXproval

Today 01:08 PM

811 Posts

Joined Apr 2014

insaneXprovalToday 01:08 PM

811 Posts

Quote from Dr.W

:

Yes, it's a very good choice to locally run AI models if you optimize (use quantization, efficient frameworks, keep models reasonable in size). It's especially good for inference, testing, and lighter workloads. For large models or many simultaneous sessions, a discrete GPU rig might do more, but this is solid for what many users want locally.

That Oculink port can help with the dedicated GPU part. And Oculink generally has better performance for eGPUs than USB4.

mesowetodit

Today 04:32 PM

661 Posts

Joined Jul 2007

mesowetoditToday 04:32 PM

661 Posts

man, i feel so old...there USB4 now??? i can't keep up with this...wheres my ps1...

1

GMKtec EVO-X1 MFF AI Mini PC: Ryzen AI 9 HX 370, 32GB LPDDR5x, 2TB SSD, OCulink $699.99

$700

$1,600

Community Voting

Leave a Comment

4 Comments

Leave a Comment

Related Searches

Popular Deals

Trending Deals