Mini PC for Local AI Models with 192 GB RAM Available

Notice: This article was created with AI.

What’s It About?

GMKtec has presented the EVO-X5 Pro, a mini PC for running large AI models locally. The device is equipped with a Ryzen AI Max+ PRO 495, which offers 16 cores with a clock rate of up to 5.2 GHz. Its distinguishing feature is the shared working memory of 192 GB LPDDR5X-8533, which both the processor and the integrated graphics can access. The Radeon 8065S GPU has 40 compute units and reaches an AI performance of 55 TOPS. The sale price is 6,249 euros for the basic model.

Background & Context

The EVO-X5 Pro is aimed at developers and companies that want to run AI applications without a cloud connection. Thanks to the unified memory architecture, the entire working memory is available to both processors, which allows a bandwidth of up to 273 GB/s. The device is meant to be able to process language models with up to 320 billion parameters locally, which is relevant for scenarios where data protection is critical.

The equipment includes four USB4 ports, two of which work at up to 80 Gbit/s, as well as two 10-gigabit LAN ports. The internal storage can be extended to up to 24 TB. Cooling is handled by a vapor chamber with three fans; the system is designed for continuous operation. For administrators, operating-system-independent remote management via ams DASH is available.

What Does This Mean?

Compact systems for compute-intensive AI tasks are becoming available to an increasing degree, though at a high price.
The shared memory pool allows more flexible use of resources than separate RAM and VRAM allocations.
Local processing of large models becomes interesting for users who have to or want to do without cloud services.
The variety of ports with fast USB4 and network connections allows use in professional environments.