A website for your local LLM
Genuine question : is there something that they are claiming about ~%15 word prediction accuracy? When I was a kid, I would be a good feature here.
Most of the time when a local model feels dumb its not the quant, its the chat template. a lot of things you learn about them are transferable by doing something like this. Most of the time when a local model feels dumb its not the quant, its the chat template. a lot of sense to me.