Jailbroken PS5s Now Run Large AI Models at 100+ Tokens per Second

How the PS5’s GPU Boosts AI Performance

A Reddit user has expanded the capabilities of the PlayStation 5 by creating a new fork of PS5LM, a port of llama.cpp that allows the console to run large language models locally. The update enables native GPU usage and increased RAM allocation, allowing the PS5 to run the 27‑billion‑parameter Qwen3.8‑27B model at about 20 tokens per second. This marks a significant step forward for AI experimentation on gaming hardware.

The enhancement was shared by Reddit user u/AdIllustrious7246, who posted the fork on GitHub. The original PS5LM project already allowed the console to host AI models, but it was limited to CPU execution and smaller models. By modifying the code to harness the PS5’s GPU, the new version can handle larger models and deliver higher throughput. The update also increases available RAM, which is crucial for running 27‑billion‑parameter networks that require gigabytes of memory.

What Does This Mean for Home Developers?

The PS5’s GPU, designed for high‑end gaming graphics, is now being repurposed for AI inference. The fork modifies the llama.cpp framework to offload matrix operations to the GPU, reducing the computational load on the CPU. This shift allows the console to process more tokens per second, a key metric for real‑time language generation. Users report that the Qwen3.8‑27B model can now generate text at roughly 20 tokens per second, a dramatic improvement over previous CPU‑only runs.

The increased RAM allocation is another critical factor. The PS5’s architecture supports up to 16 GB of GDDR6 memory, which the fork now utilizes more efficiently. By allocating more memory to the AI model, the system can keep larger portions of the network in fast memory, minimizing slow data transfers. This combination of GPU acceleration and memory optimization brings the console closer to the performance of dedicated AI hardware.

Will Future Consoles Embrace AI Natively?

The ability to run large language models on a consumer console opens new avenues for hobbyists and indie developers. They can experiment with advanced AI without investing in expensive GPUs or cloud services. The PS5’s familiar development environment also means that developers can integrate AI features into games or applications with relative ease. However, the process still requires technical knowledge of C++ and GPU programming, and the console must be jailbroken, which voids warranties and carries legal risks.

The community reaction has been enthusiastic. Users on Reddit and Discord are already discussing potential projects, from AI‑powered NPC dialogue to real‑time translation tools. Some developers are exploring ways to combine the PS5’s audio and visual capabilities with the AI’s text generation, creating immersive experiences that were previously impossible on a home console.

Frequently Asked Questions

Manufacturers are already hinting at integrating AI capabilities into next‑generation hardware. Sony’s upcoming PlayStation 6 is rumored to include dedicated AI acceleration, while other vendors are exploring similar features. If the PS5’s community success translates into industry adoption, we could see consoles that natively support large language models, enabling new genres of interactive media. The question remains whether mainstream developers will adopt these tools or continue to rely on cloud‑based AI services.

The broader implication is that consumer hardware is becoming a viable platform for advanced AI research. As more developers experiment, we may see a surge in innovative applications that blend gaming, storytelling, and machine learning. The PS5’s new fork is a clear sign that the line between entertainment and AI is blurring, offering a glimpse into the future of interactive technology.