hugpadhugpad

KBlueLeaf / TIPO-v2.1-1B-A200M

Text Generation991M11.2K30Updated Aug 22, 2026
Hugging Face

Downloads

11.2K

Likes

30

Last updated

Aug 22, 2026

License

Not available

TIPO-v2.1-1B-A200M is a 1B-A200M sparse model. 991M total parameters, ~200M active per token, plus a ~50M embedding table. It is a full retrain of TIPOv2 on a corrected dataset, for longer, at 4096 context, in pure fp16.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gguf
  • kohaku
  • text-generation
  • mixture-of-experts
  • tipo

Technical specifications

Parameters991M
Librarytransformers
Languagesen
LicenseNot available