Nehaveigur

Words are Shadows: Our inner lives consist of more

Frontier AIs, for the most part, are trained on words. Michael Pollan, in his excellent book, A World Appears, points out that unlike the minds of AIs, human consciousness is composed of more than words.

Today’s artificial minds have little, if any, direct contact with the physical world or its inhabitants; they’re trained on words and images scraped from the internet. Only someone utterly lost in cyberspace (or contorted by the linguistic turn in academia) would mistake this “dataset” – consisting entirely of representations of one kind or another – for the sum total of reality.

The internet is not the world so much as it is a shadow cast by the world.

Another way of putting this is that AI can only read the cookbook; it cannot taste the meal.

A few pages later, Pollan continues with this:

The implicit conceit in any [attempt to describe a stream of thought] is that human consciousness can be rendered into words. But does it follow that consciousness consists of words, that inner speech is the medium in which thought is conducted? Not necessarily. This would be like saying that artists who use oil to make portraits believe that people are made of paint.