lemonilia / LimaRP-Llama2-7B-v3-EXPERIMENT

This is an experimental version of LimaRP for Llama2 with an updated dataset (1800 training samples) and a 2-pass training procedure. The first pass includes unsupervised finetuning on about 6800 stories within 4k tokens length and the second pass is LimaRP with changes introd…