This collaborative space allows users to contribute additional information, tips, and insights to enhance the original deal post. Feel free to share your knowledge and help fellow shoppers make informed decisions.
The only downside of this box is older WiFi vs WiFi 7 and it's soldered ram so no way to upgrade. Realistically to run any bigger LLM you'll want 96 - 128 gb ram
The only downside of this box is older WiFi vs WiFi 7 and it's soldered ram so no way to upgrade. Realistically to run any bigger LLM you'll want 96 - 128 gb ram
This is not really targeted for running big LLM models but a more portable solution. 890M is a decently powerful iGPU but not really suitable for running LLM with huge parameters. The the AI X1 pro model with same CPU does come with SODIMM slot. This machine is limited to 332GB but uses faster LPDDR5X memory which means, you will get better iGPU performance due to higher bandwidth and hence slightly better gaming.
The only downside of this box is older WiFi vs WiFi 7 and it's soldered ram so no way to upgrade. Realistically to run any bigger LLM you'll want 96 - 128 gb ram
You want the 395+ Max to run LLMs on its unified memory like platform. It's a little deceptive on AMDs part they use the same naming schema for products that have completely different capabilities.
You want the 395+ Max to run LLMs on its unified memory like platform. It's a little deceptive on AMDs part they use the same naming schema for products that have completely different capabilities.
This also has "unified memory." That's literally how all iGPUs work since they were invented. The AI hype era has reduced tech literacy to new lows, lmao
The only downside of this box is older WiFi vs WiFi 7 and it's soldered ram so no way to upgrade. Realistically to run any bigger LLM you'll want 96 - 128 gb ram
These use LPDDR5X 7500 so your trade off for non-sodimm, the soldered memory is a lot faster both in clock speeds and response latency. Its beneficial for gaming but less so for other tasks. That being said they do make models that do support sodimm for more serious work stations if needed.
I also dont think wifi 7 is really any benefit tbh yet. Most people dont have wifi 7 routers let alone have maxed out the capabilities of wifi 6 or even 6e yet.
These use LPDDR5X 7500 so your trade off for non-sodimm, the soldered memory is a lot faster both in clock speeds and response latency. Its beneficial for gaming but less so for other tasks. That being said they do make models that do support sodimm for more serious work stations if needed. I also dont think wifi 7 is really any benefit tbh yet. Most people dont have wifi 7 routers let alone have maxed out the capabilities of wifi 6 or even 6e yet.
WiFi 6E has the same low latency possibilities as WiFi 7 and is faster than my internet provider even grants. WiFi 7 has faster max bandwidth and some other router features that some may not care about.
Quote from Sohvkhan :
You want the 395+ Max to run LLMs on its unified memory like platform. It's a little deceptive on AMDs part they use the same naming schema for products that have completely different capabilities.
This also has "unified memory." That's literally how all iGPUs work since they were invented. The AI hype era has reduced tech literacy to new lows, lmao
No they don't. Sharing same physical memory for system and integrated graphics is not UMA or Unified Memory Architecture, it's quite a bit complex than that.
No they don't. Sharing same physical memory for system and integrated graphics is not UMA or Unified Memory Architecture, it's quite a bit complex than that.
Unified Memory Architecture is the ability for the GPU and CPU to address the same pool of memory and iGPUs have been doing this for a very long time. I suppose it is technically distinct from the concept of shared physical memory but functionally it has little impact on the operation of games or most programs. AMD and Intel iGPUs/"APUs" have had this ability for well over a decade.
Moreover, both the 370 and 395 have the same memory architecture so the OP is incorrect. Some 370 builds even have soldered RAM but the issue is the dual channel bandwidth which is the real bottleneck.
Perhaps that theoretically a game could avoid unnecessary movements to VRAM from system RAM under this architecture but no games on PCs, to the best of my knowledge, actually operate in this fashion. And they must be specifically programmed to do so, which is probably incredibly unlikely. Only video games on consoles conceivably work this way because of their extremely homogenous hardware and strong incentive to do so.
The only reason Apple's "Unified memory" offers so much more performance, is ironically, due to all the efforts they put in the physical design of the memory and the interconnection with the CPU/GPU to offer as much bandwidth as possible which dramatically accelerates memory bound tasks. The only way you could exceed this is to put a bunch of HBM next to the CPU/GPU. And then there are plenty of other very advanced techniques that are far beyond my understanding that Apple used to make their processors so fast and efficient, not just the huge memory bandwidth.
In short, the OP going on about the "unified memory" of the 395 being different is incorrect and that unified memory access has been implemented for decades. What separates the 395 from the 370, other than the huge iGPU is really the quad channel bandwidth and to some degree the soldered RAM.
:
No they don't. Sharing same physical memory for system and integrated graphics is not UMA or Unified Memory Architecture, it's quite a bit complex than that.
Unified Memory Architecture is the ability for the GPU and CPU to address the same pool of memory and iGPUs have been doing this for a very long time. I suppose it is technically distinct from the concept of shared physical memory but functionally it has little impact on the operation of games or most programs. AMD and Intel iGPUs/"APUs" have had this ability for well over a decade.
Moreover, both the 370 and 395 have the same memory architecture so the OP is incorrect. Some 370 builds even have soldered RAM but the issue is the dual channel bandwidth which is the real bottleneck.
Perhaps that theoretically a game could avoid unnecessary movements to VRAM from system RAM under this architecture but no games on PCs, to the best of my knowledge, actually operate in this fashion. And they must be specifically programmed to do so, which is probably incredibly unlikely. Only video games on consoles conceivably work this way because of their extremely homogenous hardware and strong incentive to do so.
The only reason Apple's "Unified memory" offers so much more performance, is ironically, due to all the efforts they put in the physical design of the memory and the interconnection with the CPU/GPU to offer as much bandwidth as possible which dramatically accelerates memory bound tasks. The only way you could exceed this is to put a bunch of HBM next to the CPU/GPU. And then there are plenty of other very advanced techniques that are far beyond my understanding that Apple used to make their processors so fast and efficient, not just the huge memory bandwidth.
In short, the OP going on about the "unified memory" of the 395 being different is incorrect and that unified memory access has been implemented for decades. What separates the 395 from the 370, other than the huge iGPU is really the quad channel bandwidth and to some degree the soldered RAM.
I am the OP and I am correct. And 370 and 395 does not have same memory architecture, that you just made up right now. Making is Dual Channel or Quad Channel does not increase memory overall bandwidth, that depends on the speed of the memory and the Memory Bus width. Strix Halo uses 256 Bit Memory bus whereas all modern Consumer x86 Processors, including Ryzen AI 9 HX 370, uses a normal 128 Bit memory Bus. So, you are incorrect here.
Now the term Strix Halo is called Unified memory Access, not Unified memory Architecture. What it does is enables the CPU and the iGPU to access any location of the memory from the single Address Space which is 1st in x86 Processor, introduced by Strix Halo.
In any other Intel or AMD Consumer Processors with integrated Graphics, when a specified amount is allocated to the iGPU, it creates a separate address space, accessible to the GPU only. When any data is needs to be loaded to the GPU Buffer, 1st it has to be loaded to the system memory currently available, and then it gets copied to the GPU allocated memory and the GPU memory address space gets updated. After that only, the GPU can start processing the data. Once the processing is done, it again needs to come from the shared GPU memory to the system memory and then gets stored in the storage. Because of that huge number of to and from memory operations, it bottlenecks the performance as memory operations waste 100s of thousands CPU and GPU Clock Cycles. On top of that, it is an inefficient way of memory allocation because if say 8GB is allocated to the GPU and system has 24GB of memory and currently only using 10GB, the raste can't be used by the iGPU, even if that is free.
You can literally see that by looking at the task monitor if you load a big LLM model to the iGPU where first system memory will be filled with it and then it will be start filling the shared GPU memory.
In Unified memory Access, once the data is loaded and directed to the CPU or iGPU, they can directly pick it, without any separate address space required by CPU and iGPU. Currently Windows still does not support this feature fully and that's why even in Strix Halo, people need to allocate a fixed amount to it.
I am sure you probably thought since integrated Graphics in Windows PCs are called "UMA" Graphics for decades, it must be Unified memory Access since the beginning of integrated graphics in CPU. And I don't think you also understood how apple has achieved better performance either and thrown some mumbo jumbo from here and there. Apple uses Unified memory Access, since its SOC, and OS and Frameworks, all are designed by them, it uses an extremely optimized Close to metal Software-hardware combination for running its instruction set, the main strong feature of any RISC processor, where the OS/Compiler should have very low-level view of the actual architecture and can do a lot of heavy lifting and generate optimize code paths. In hardware front, they simply uses Unified memory Access + Higher memory Bus + Higher speed LPDDR5X Memory to offer a high memory bandwidth for the whole package, not some magical optimization.
An another thing, since here UMA is implemented, for both Apple Silicon and AMD Strix Halo, between Heterogeneous Compute Units, CPU and iGPU and NPU, this is also called hUMA. UMA normally refers to classical Multi-Processor or MultiCore systems where the whole package of the similar Processing Cores see the memory as same.
1
Like
Helpful
Funny
Not helpful
Join The Conversation
Share your experience with the Slickdeals community
Share information with the community. Please follow our Community Guidelines and be kind!
Join The Conversation
Share your experience with the Slickdeals community
Share information with the community. Please follow our Community Guidelines and be kind!
13 Comments
Sign up for a Slickdeals account to remove this ad.
I also dont think wifi 7 is really any benefit tbh yet. Most people dont have wifi 7 routers let alone have maxed out the capabilities of wifi 6 or even 6e yet.
Sign up for a Slickdeals account to remove this ad.
https://slickdeals.net/share/iphone_app/t/18534001
You want the 395+ Max to run LLMs on its unified memory like platform. It's a little deceptive on AMDs part they use the same naming schema for products that have completely different capabilities.
This also has "unified memory." That's literally how all iGPUs work since they were invented. The AI hype era has reduced tech literacy to new lows, lmao
Unified Memory Architecture is the ability for the GPU and CPU to address the same pool of memory and iGPUs have been doing this for a very long time. I suppose it is technically distinct from the concept of shared physical memory but functionally it has little impact on the operation of games or most programs. AMD and Intel iGPUs/"APUs" have had this ability for well over a decade.
Moreover, both the 370 and 395 have the same memory architecture so the OP is incorrect. Some 370 builds even have soldered RAM but the issue is the dual channel bandwidth which is the real bottleneck.
Perhaps that theoretically a game could avoid unnecessary movements to VRAM from system RAM under this architecture but no games on PCs, to the best of my knowledge, actually operate in this fashion. And they must be specifically programmed to do so, which is probably incredibly unlikely. Only video games on consoles conceivably work this way because of their extremely homogenous hardware and strong incentive to do so.
The only reason Apple's "Unified memory" offers so much more performance, is ironically, due to all the efforts they put in the physical design of the memory and the interconnection with the CPU/GPU to offer as much bandwidth as possible which dramatically accelerates memory bound tasks. The only way you could exceed this is to put a bunch of HBM next to the CPU/GPU. And then there are plenty of other very advanced techniques that are far beyond my understanding that Apple used to make their processors so fast and efficient, not just the huge memory bandwidth.
In short, the OP going on about the "unified memory" of the 395 being different is incorrect and that unified memory access has been implemented for decades. What separates the 395 from the 370, other than the huge iGPU is really the quad channel bandwidth and to some degree the soldered RAM.
No they don't. Sharing same physical memory for system and integrated graphics is not UMA or Unified Memory Architecture, it's quite a bit complex than that.
Unified Memory Architecture is the ability for the GPU and CPU to address the same pool of memory and iGPUs have been doing this for a very long time. I suppose it is technically distinct from the concept of shared physical memory but functionally it has little impact on the operation of games or most programs. AMD and Intel iGPUs/"APUs" have had this ability for well over a decade.
Moreover, both the 370 and 395 have the same memory architecture so the OP is incorrect. Some 370 builds even have soldered RAM but the issue is the dual channel bandwidth which is the real bottleneck.
Perhaps that theoretically a game could avoid unnecessary movements to VRAM from system RAM under this architecture but no games on PCs, to the best of my knowledge, actually operate in this fashion. And they must be specifically programmed to do so, which is probably incredibly unlikely. Only video games on consoles conceivably work this way because of their extremely homogenous hardware and strong incentive to do so.
The only reason Apple's "Unified memory" offers so much more performance, is ironically, due to all the efforts they put in the physical design of the memory and the interconnection with the CPU/GPU to offer as much bandwidth as possible which dramatically accelerates memory bound tasks. The only way you could exceed this is to put a bunch of HBM next to the CPU/GPU. And then there are plenty of other very advanced techniques that are far beyond my understanding that Apple used to make their processors so fast and efficient, not just the huge memory bandwidth.
In short, the OP going on about the "unified memory" of the 395 being different is incorrect and that unified memory access has been implemented for decades. What separates the 395 from the 370, other than the huge iGPU is really the quad channel bandwidth and to some degree the soldered RAM.
Now the term Strix Halo is called Unified memory Access, not Unified memory Architecture. What it does is enables the CPU and the iGPU to access any location of the memory from the single Address Space which is 1st in x86 Processor, introduced by Strix Halo.
In any other Intel or AMD Consumer Processors with integrated Graphics, when a specified amount is allocated to the iGPU, it creates a separate address space, accessible to the GPU only. When any data is needs to be loaded to the GPU Buffer, 1st it has to be loaded to the system memory currently available, and then it gets copied to the GPU allocated memory and the GPU memory address space gets updated. After that only, the GPU can start processing the data. Once the processing is done, it again needs to come from the shared GPU memory to the system memory and then gets stored in the storage. Because of that huge number of to and from memory operations, it bottlenecks the performance as memory operations waste 100s of thousands CPU and GPU Clock Cycles. On top of that, it is an inefficient way of memory allocation because if say 8GB is allocated to the GPU and system has 24GB of memory and currently only using 10GB, the raste can't be used by the iGPU, even if that is free.
You can literally see that by looking at the task monitor if you load a big LLM model to the iGPU where first system memory will be filled with it and then it will be start filling the shared GPU memory.
In Unified memory Access, once the data is loaded and directed to the CPU or iGPU, they can directly pick it, without any separate address space required by CPU and iGPU. Currently Windows still does not support this feature fully and that's why even in Strix Halo, people need to allocate a fixed amount to it.
I am sure you probably thought since integrated Graphics in Windows PCs are called "UMA" Graphics for decades, it must be Unified memory Access since the beginning of integrated graphics in CPU. And I don't think you also understood how apple has achieved better performance either and thrown some mumbo jumbo from here and there. Apple uses Unified memory Access, since its SOC, and OS and Frameworks, all are designed by them, it uses an extremely optimized Close to metal Software-hardware combination for running its instruction set, the main strong feature of any RISC processor, where the OS/Compiler should have very low-level view of the actual architecture and can do a lot of heavy lifting and generate optimize code paths. In hardware front, they simply uses Unified memory Access + Higher memory Bus + Higher speed LPDDR5X Memory to offer a high memory bandwidth for the whole package, not some magical optimization.
An another thing, since here UMA is implemented, for both Apple Silicon and AMD Strix Halo, between Heterogeneous Compute Units, CPU and iGPU and NPU, this is also called hUMA. UMA normally refers to classical Multi-Processor or MultiCore systems where the whole package of the similar Processing Cores see the memory as same.
Join The Conversation
Share your experience with the Slickdeals community
Share information with the community. Please follow our Community Guidelines and be kind!