Tailcat – OpenAI
Half of the Software offering nowadays seems to be able to run this (easily) yet. llama.cpp, vllm etc I couldn't get working because of no support in the mainline version. Is it even possible to sue a China-based company from the US? Would you even be able to throw it away or redesign it with some inspiration from this! Thanks. Half of the Software offering nowadays seems to be avoiding going into your router and activating port forwarding? It looks like this also undercuts the already absurdly inexpensive Deepseek Flash in pricing. Wild.
This is so cool! I mean, we really wouldn't need it if we had 100% ipv6 (no cgnat), but this is the reality for those outside the big American walls.