trollek / ThoughtStream-4B-v0.1

Text Generation4B220Updated Jul 22, 2024

Downloads

22

Likes

0

Last updated

Jul 22, 2024

License

apache-2.0

This model is based on h2oai/h2o-danube3-4b-base and fine-tuned using LoRA+ and BAdam with LLama-Factory. It uses the ChatML template, without a system message, and was trained on the ThoughtfulAssistant-v01 dataset.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational
  • en

Technical specifications

Parameters4B
Librarytransformers
Languagesen
Licenseapache-2.0