A jailbroken has been successfully repurposed as a local AI server to run a 27-billion-parameter Large Language Model. Using a project titled PS5LM, Redditor u/AdIllustrious7246 ported as a native app via a -based RADV driver.
The native implementation increased available memory from 6GB to 11.4GB, allowing the model to run at 20.9 tokens per second. The setup utilized 91 percent of memory with a 64K context window, drawing 86W of power while maintaining a steady 54°C.
This experiment demonstrates the potential of the console's 16GB GDDR6 memory and 448GB/s bandwidth for AI tasks. However, users should note that running a native llama.cpp app requires a jailbreak, which voids the warranty and risks permanent online bans.