Paul Krill
Editor at Large

Google releases Gemma 3n models for on-device AI

news
Jul 9, 20252 mins

Gemma 3n models are multimodal by design and available in two sizes that operate with as little as 2GB and 3GB of memory, Google said.

Google Googleplex
Credit: Shutterstock

Google has released its Gemma 3n AI model, positioned as an advancement for on-device AI and bringing multimodal capabilities and higher performance to edge devices.

Previewed in May, Gemma 3n is multimodal by design, with native support for image, audio, video, and text inputs and outputs, Google said. Optimized for edge devices such as phones, tablets, laptops, desktops, or single cloud accelerators, Gemma 3n models are available in two sizes based on โ€œeffectiveโ€ parameters, E2B and E4B. Whereas the raw parameter counts for E2B and E4B are 5B and 8B, respectively, these models run with a memory footprint comparable to traditional 2B and 4B models, running with as little as 2GB and 3GB of memory, Google said.ย 

Announced as a production release June 26, Gemma 3n models can be downloaded from Hugging Face and Kaggle. Developers also can try out Gemma 3n in Google AI Studio.

Gemma 3n is built on the same technology as Googleโ€™s Gemini nano models, Google said. Gemma 3n components are offered such as the MatFormer architecture for compute flexibility, Per Layer Embeddings (PLE) for memory efficiency, LAuReL and AltUp for architectural efficiency, and audio and vision encoders optimized for on-device use cases. Additionally, 140 languages are supported for text and 35 languages for multimodal understanding. The E4B-sized version achieves an LMArena score of more than 1300, making it the first model below 10 billion parameters to reach this benchmark, Google said.

The first Gemma model family was launched in 2024. The family includes more than a dozen specialized models for tasks ranging from safeguarding to medical applications as well as community innovations including enterprise computer vision to Japanese Gemma variants, the company said.

Paul Krill

Paul Krill is editor at large at InfoWorld. Paul has been covering computer technology as a news and feature reporter for more than 35 years, including 30 years at InfoWorld. He has specialized in coverage of software development tools and technologies since the 1990s, and he continues to lead InfoWorldโ€™s news coverage of software development platforms including Java and .NET and programming languages including JavaScript, TypeScript, PHP, Python, Ruby, Rust, and Go. Long trusted as a reporter who prioritizes accuracy, integrity, and the best interests of readers, Paul is sought out by technology companies and industry organizations who want to reach InfoWorldโ€™s audience of software developers and other information technology professionals. Paul has won a โ€œBest Technology News Coverageโ€ award from IDG.

More from this author