liminerity / Mistral-quiet-star-demo

Text Generation7.2B2727Updated Apr 5, 2024

Downloads

27

Likes

27

Last updated

Apr 5, 2024

License

apache-2.0

- QSTAR - I think this model is proof of my theory that you dont need a special architecture to train a llm to reason. The techniques i imployed to make this could be greatly expanded on and coupled with a agent system to achieve a functioning low cost agi system.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • mistral
  • text-generation
  • unsloth
  • trl

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0