Article

Tiiny AI has developed the AI Pocket Lab, the smallest AI supercomputer, measuring 14.2 × 8 × 2.5 cm. It can run large language models (LLMs) with up to 120 billion parameters locally without requiring internet access.

The device is powered by a 12-core ARM processor and includes 80 GB of RAM, with 48 GB dedicated to AI processing and a specialized NPU. It provides approximately 190 TOPS of performance. The system employs software optimizations like TurboSparse and PowerInfer for efficient operation. It can function offline, making it suitable for remote research applications and reducing reliance on data centers.