Gryphe / Gemma-4-26B-A4B-StyleTune-V2

Text Generation27B1K89Updated Jun 20, 2026

Downloads

1K

Likes

89

Last updated

Jun 20, 2026

License

apache-2.0

As promised, a slightly less wonky 26B-A4B Style Tune! Turns out you really shouldn't use this technique with multiple epochs. I delved deep into the data and found that a second epoch does all sorts of nasty stuff to MoE models, so V2 is a single epoch of an otherwise unchang…

Tasks & library

  • text generation

Tags

  • gemma4
  • conversational
  • instruct
  • finetune
  • roleplay
  • creative-writing

Technical specifications

Parameters27B
LibraryNot available
Languagesen
Licenseapache-2.0