[feature request] all models.

[0wwafa]

Is there a way to use this on big models like llama 3.1 70B o Mistral Large? or even to make 14B models smaller?

Mistral/Meta/Microsoft models would be great to test with this.