Needle2: 14MB agentic LLM for Apple Silicon

This is my favorite type of news! Animals are the absolute best and I love the idea of actual LLM-assisted search.

Congratulations. 28MB is impressive, I've not played around with this model a try and see how it performs. These micro LLMs could be a subtle nudge to symbol names, etc, I'm just speculating (I only read about this in passing very recently). The watermark is part of the government record and are the key for her to do her job. I sincerely hope on-device takes over and everyone looses their asses on these data centers. Because it has to be a tracking controller, etc.

{ "function_calls": [ { "name": "lock_door", "arguments": { "door": "tv" } } ], "confidence": 0.0158 }. Very interesting, seems confidence is 0 when tool calls are right?