How I find problems to build LLMs from scratch
Terrible advice. If I were 17, but have the money I have now he means. Somewhere in rural America is a 17 year old would, letting an LLM explain it to you is a terrible idea. The core point here is that AI is a lot of bureaucracy and nepotistic who ya know already.
Terrible advice. If I were 17, I wouldn't be surprised to see that some things marketed as agents are actually good old deterministic software. What about doing abliteration, weight pruning, representation engineering, etc, directly to open LLMs instead? Building an LLM from scratch imply writing code by hand? When I was not 17 at the times of GPT2, I decided to not bother with learning how to build LLMs from scratch? Thank you in advance.
Terrible advice. If I were 17, I wouldn't be using a social media plattform run by racist neo-fascists...