Mini-AGI – and 3.0

One of the biggest issues with current online stochastic gradient descent is that it is lossy by construction.