nvidia / Llama-3.1-Minitron-4B-Width-Base

Llama-3.1-Minitron-4B-Width-Base is a base text-to-text model that can be adopted for a variety of natural language generation tasks. It is obtained by pruning Llama-3.1-8B; specifically, we prune model embedding size and MLP intermediate dimension. Following pruning, we perfo…