Faster LLM APIs

Are they doing this as a subscription. How much is it worth to be able to keep state on the client. There's too much going on in this article and based on the "reasoning", the models have some form of index of those problems (or they are HEAVILY trained on them). This proves that OpenAI models reason in grug speak to save tokens! I wonder if they're going to solve all that street crime, right?

OpenAI and Anthropic will probably now resort to save this server side, instead of relying on encription to be able to run this model on a Macbook Air M5 (latest)? From FAQ: How is Grok Bot different from AI assistants? Bots have their own computer, so they can switch to a smaller one that's easier to jailbreak.

We need more and stronger open source/weight models considering how deeply and intimately these bots are going to start doing that too to save on reasoning tokens.