越狱 PS5 被改造成本地 AI 服务器，可运行 27B LLM，小模型速度达 124 tok/s 但有局限
A Jailbroken PS5 Got Turned Into a Local AI Server That Can Run A 27B LLM, Smaller Models Can Reach Impressive Speeds Of 124 Tok/s, But There Are Limitations
越狱 PS5 经非官方 llama.cpp 移植改造为本地 AI 服务器，成功运行 27B 参数的 Qwen3.8-27B。优化后可用内存从 6GB 升至 11.4GB，Qwen3.8-27B 速度 20.9 tok/s，小模型 Gemma 4 E4B 达 61 tok/s、Llama 3.2 3B 达 124 tok/s。运行需越狱，会失去保修并可能导致联机游戏封禁。
The PS5’s 16GB GDDR6 memory pool and 448GB/s bandwidth are decent specifications for running a local AI model, and it appears that someone has actually attempted this daring experiment, albeit with a bunch of compromises. With the trick being to move the work from the CPU to the GPU, one user managed to free up ample memory and successfully ran Qwen3.8-27B, a 27-billion-parameter LLM.
The project titled “PS5LM” leveraged the CPU as a payload but limited the available memory to just 6GB; an optimized port raised that RAM to 11.4GB
To jumpstart the experiment, the Redditor u/metover introduced an unofficial llama.cpp port that enabled the PlayStation 5 to run AI models by using the CPU as a payload. Unfortunately, as a different Redditor with the handle “u/AdIllustrious7246” finds out, adopting this approach severely limits the available memory to just 6GB, meaning that there’s not going to be any framebuffer available to run the denser AI models.
As a result, he managed to bring llama.cpp to the PS5 as a native app by using Vulkan through a RADV port, which is an open-source AMD driver from Mesa. From a paltry 6GB of memory, this change increased the figure to 11.4GB, providing sufficient headroom to run a heavily quantized version of Qwen3.8-27B. At 16-bit precision, the required memory would be 54GB, which is only possible on systems with multiple GPUs or a single GPU paired with a large amount of system RAM.
Since the PS5 lacks these configurations, the version Qwen3.8-27B-UD-IQ2_XXS was attempted on the console, storing weights at roughly 2 bits each, shrinking the size to 6.8GB, as shown in the dashboard image. Naturally, the biggest trade-off of running a heavily quantized AI model is quality, resulting in more mistakes and weaker reasoning from Qwen3.8-27B. With a context window set at 64K, the total memory usage came to 91 percent.
2 of 9
Since the PS5 has decent memory bandwidth, Qwen3.8-27B could reach speeds of 20.9 tok/s, with the GPU at 100 percent and CPU at 2 percent. Smaller AI models delivered a higher token generation result, with Gemma 4 E4B hitting 61 tok/s and Llama 3.2 3B reaching 124 tok/s. The total power draw was 86W, meaning that the PS5 stayed cool at 54°C. While it’s an impressive result for a console that’s just meant to play games, there are several compromises that you should know about.
The 16GB memory means you’re limited to running a heavily quantized 27B LLM, or significantly smaller AI models, meaning that you might not be witnessing the desired quality. Additionally, getting a native app of llama.cpp to run on the PS5 requires a jailbreak, which will void your warranty and could also result in online game bans. If you thought this was impressive, wait until you learn about another person who ran a 120B AI model using a total of six devices, which included a Galaxy S24+.
News Source: Reddit
About the author: Omar Sohail is a reporter and analyst for Wccftech's mobile section, specializing in the technology and business of the mobile industry. His expertise lies in the intricate hardware supply chain, covering developments in semiconductor manufacturing, chip lithography, and camera sensor technology.
Follow Wccftech on Google to get more of our news coverage in your feeds.
来源：Wccftech · wccftech.com