Scaling Hypothesis

https://gwern.net/scaling-hypothesis @gwern @article

It is ‘just’ a text prediction model, an idiot savant of text; but an idiot savant, we should remember, is only a genetic mutation or bit of brain damage away from a normal human.

The scaling hypothesis relies on the notion that human brains seem to be just scaled up primate brains. The same might be said for NN’s.