Why are More Neurons Better?

Published by

on

This is an excellent question whose answer is only obvious at first glance, asked by Scott Alexander on Astral Codex Ten. The correlation between the number of neurons and intelligence holds for biological brains and for AI, if we take the number of parameters to be equivalent to the number of neurons.

Part of the answer is that minds with more neurons can encode more patterns. Minds with fewer neurons need to compress the patterns more, and that compression loss means that it’s harder to accurately do pattern matching.

As Alexander points out, that may not be the full answer. Why does practice improve performance at pattern matching, such as is needed to solve Raven’s progressive matrices, only a little, and never to the same level than a genius who didn’t practice at all?

One possibility is that you have some kind of “pattern matching region” taking up some very specific percent of your brain, and the bigger the brain, the bigger the “pattern matching region”. […] But this doesn’t really seem right – endless practice on thousands of Raven’s style patterns helps a little, but a true genius will still beat you. But by the end of your practice, you will have far more patterns stored than the genius does. So what do they have that you don’t?

Unfortunately, I don’t think the attempt at explanation that follows in Alexander’s blog is fully satisfying either.

3 responses to “Why are More Neurons Better?”

  1. Questions about Intelligence – Nehaveigur Avatar

    […] Are there problems for which intelligence isn’t helpful? […]

    Like

  2. Bees and Fish – Nehaveigur Avatar

    […] to o3, the bee has only around 1 million neurons, while a zebrafish has ten million. Given that neuron count is a correlated with intelligence, it’s not clear how bees get more oomph out of […]

    Like

  3. Bigger Brains – Nehaveigur Avatar

    […] the relationship between neuron count and intelligence isn’t straightforward. For starters, it’s not clear why more neurons are better. Part of the answer is that more neurons allow us to have more fine-grained concepts, and that in […]

    Like

Previous Post
Next Post