According to reports, Samsung Electronics recently announced the LPDDR5X-PIM architecture and detailed performance indicators for end-side AI devices such as smartphones and AI PCs. This technology can directly complete some computational processing within the memory, and there is no need to repeatedly transfer data to the processor. Samsung used Meta's 8 billion parameter model “Llama 3.1” for testing. The results showed that processing time: reduced from 12.3 seconds of traditional LPDDR5X to 5.4 seconds, about 2.3 times faster; Token processing capacity per second increased from 27 to 81.3, which is 3 times that of existing products.

Zhitongcaijing · 3d ago
According to reports, Samsung Electronics recently announced the LPDDR5X-PIM architecture and detailed performance indicators for end-side AI devices such as smartphones and AI PCs. This technology can directly complete some computational processing within the memory, and there is no need to repeatedly transfer data to the processor. Samsung used Meta's 8 billion parameter model “Llama 3.1” for testing. The results showed that processing time: reduced from 12.3 seconds of traditional LPDDR5X to 5.4 seconds, about 2.3 times faster; Token processing capacity per second increased from 27 to 81.3, which is 3 times that of existing products.