Byte-Sized

Small Language Models Make Edge AI Practical

Sub-3B parameter models achieve usable quality for on-device AI applications.

2025-11-22

Small language models (SLMs) under 3 billion parameters are making on-device AI practical. Models like Phi-3-mini, Gemma-2B, and Llama-3.2-1B can now run on smartphones, IoT devices, and embedded systems with acceptable quality for many use cases. Key applications include offline voice assistants, local document processing, and privacy-preserving AI that never sends data to the cloud.