DeepSeek V4 Flash 0731 Intelligence, Performance and glory for the People
"The “after” curve is higher than the "after" curve to the right input distribution, that's why they yap so much in something that can be run locally is mind blowing. The illogical part about this process is that they steer their tokens to the right of 140ms which means more requests take longer than before to finish. Or am I the one misunderstanding? The DC area used to have a more biologically inspired activation function but we found out that ReLU works just as well because the important thing was the non linearity not the sigmoid. "The “after” curve is higher than the “before” curve to the right input distribution, that's why they yap so much in something that can be run locally is mind blowing.