Tiiny AI Develops World’s Smallest AI Supercomputer, AI Pocket Lab
Tiiny AI has created AI Pocket Lab, the smallest AI supercomputer, measuring 14.2 × 8 × 2.5 cm. It operates large language models with up to 120 billion parameters locally without internet access. The device features a 12-core ARM processor, 80 GB RAM, and a specialized NPU, delivering 190 TOPS. It utilizes software optimizations like TurboSparse and PowerInfer for efficient processing. This portable supercomputer could function offline, beneficial for research in remote areas and reducing data center reliance.
Theia Market Signal Identification - AI Assisted
Tiiny AI has developed the AI Pocket Lab, the smallest AI supercomputer, measuring 14.2 × 8 × 2.5 cm. It can run large language models (LLMs) with up to 120 billion parameters locally without requiring internet access.
The device is powered by a 12-core ARM processor and includes 80 GB of RAM, with 48 GB dedicated to AI processing and a specialized NPU. It provides approximately 190 TOPS of performance. The system employs software optimizations like TurboSparse and PowerInfer for efficient operation. It can function offline, making it suitable for remote research applications and reducing reliance on data centers.
Comments