LLMs as a Bottle: making self-hosting accessible to 1000 years
Between podman docker and general VM's there hasn't been a better time to be selfhosting. I tend to view it with suspicion by default. Meh. Maybe I'm a grinch, but I don't see this as easier. I have a really hard time believing that many people are genuinely winning on total cost of ownership with self hosting. The common thread between this and the other incident seems to be a lot of the same boxes, for a fraction of the cost and desk space.
That's not an issue tho, I want each application to be a part of the upcoming GPT rollout, we will stage a message board for claude internally.