Wednesday, July 20, 2011

Reductionism and Whole/Parts

In my previous post, I proposed a three-level model of intelligence: Life, Psychology, and Intelligence, which is based on the theories of far from equilibrium which again could be based on quantum theories. So total 5-level models, including life and non-life. This article explains some philosophical reasoning behind this model.

These models sounds like reductionism, but not exactly.

Let's first consider the phrase "the whole is greater than the sum of its parts", which has been talked by many, many people and many, many times.

In reality, the highly abstracted "whole" could be much less than the sum of its parts, if people ignore too many details and don't have enough knowledge of parts.

So "the whole is greater than the sum of its parts" is only true when you have the enough knowledge of parts. Usually it is not the case. People should be aware of the constraints of those sayings which sounds correct.

However, in practice, many people still follow such type of thinking, not exactly, but actually in a loosed form, consciously or not consciously, "the whole could provide additional information to the sum of its parts". Here the constraint of "enough knowledge of parts" is removed. But pay attention to "could". You take the risk for your own by following this thinking. It only COULD be true.

The constraint tells us, people need pay attention to the details of parts, especially when things are not done well. By coming back to fundamentals, people could enrich their understanding, adjust their approaches. 

However, only low-level details are not good enough. By the loosed version of  "the whole could provide additional information to the sum of its parts", people could establish high-level principles, which may be not obvious in low-level regular phenomina, to understand the whole better. Brussels-Austin approach could gain hints from the studies of life, psychology and intelligence, to push their researches further. 

So although "the whole is greater than the sum of its parts" is not always true, this three-level model of intelligence is not pure reductionism.

Things AI/Robots Can Do Well and Not Well So Far

1) AI can play chess quite well. Chess is played on small 8x8 boards with strict rules, a task extremely fitting to AI. However, chess softwares are continuely being improved by humans.

Even for chess, I don't know for a fixed chess software without any farther tuning from humans, how long it can keep winning against top human players.  Since humans can learn better than AI so far.

2) AI can play GO well, but not so well as chess, due to combinatorial explosion. GO is played on 19x19 boards, also with strict rules.

3) Auto car pilots. It runs on roads built for cars and with highly-regulated traffic rules. Only a few cases are reported so far. Don't know how well these systems can run in large scale and randomly picked road situations.

A reasonable guess is:  potentially auto car pilots could do well in standard car racing competition if not already, which runs on routes regulated better than usual roads, easier for safety. Although improving performance might be more difficult initially than running at normal speeds, safety could be more difficult to solve eventually.

4) Robots' capabilities are highly constrained by AI.

They can play Rubiks Cube extremely well, since there are fixed algorithms. They can play music instruments well, with fixed actions. They can even play pingpong with humans, which is on simple platform with simple rules. Hopefully, robots could catch up with or even exceed humans soon with pingpong.  
  
They can walk. With two legs, they can walk on flat places, or stairs with regular shapes, but not good at mountain surfaces yet. With four legs, they could walk on rough terrains, but may not on very steep hills or rocky mountains as deers and other animals can, not to mention to find a route by themselves there. With six legs, they can even climb on coarse walls or trees, but not seen on glass or steel walls (by me) yet, probably would in near future since glass or steel wall surface is well-defined.
  
They could emulate simple creatures like fishes, moths, somehow snakes, but not even behave like chicken, rats, cats, dogs, etc., yet so far.
  
So even to achieve goals of weak AI, robots still need much more advanced AI theories and methodologies.

There is one category: industrial robots, which already play significant roles in reality. They are designed for well-defined tasks. However, there are lessons could be taken from the Saturn project in 1980s, if people want to make big breakthrough.

5) Handwriting recognization, voice recognization, image and video-processing, etc. These can do well in certain contexts and with specific targets to recognize, such as moving objects. AI could recognize what people write better if it already knows what type of things are written: digitals, English letters, Chinese characters, mathematical signs, etc. Or for voice: what languages people are speaking, or they are singing a song, or just playing Kouji, etc.
......

People could add more to this list. However the list would still not be long. In most situations, computers only can aid and enhance humans, not replace them.

AI cannot do most things humans can. So IMHO, AI is still in poineering stage. Only a few things could be implemented in software so far. More research is needed, including much philosophical thinking.

Don't limit youself to software implementation in AI researches. Most of them cannot be implemented so far.

Life, Psychology, and Intelligence: A Three-Level Model of Intelligence

Studies of Artifical Intelligence (AI) are still very difficult in many areas, such as in Robotics, etc. When things are not going well enough, people have to come back to fundamentals.

Traditionally, many of AI researches are based on Turing Machine or equivalences, which are highly influenced by deterministic models.

However, for the real world, there are quantum theories, etc., which suggest the possibility of nondeterministism.

Some scientists tried to build the human mental models based on quantum theories. However, the difference between the time scale of neuron firing and excitations in microtubules and the decoherence time tells us there are some links in the middle still missing.

That is the reason I propose this three-level model: Life, Psychology, and Intelligence, to fit in the gap.

Psychology is a subdomain of life, built on top of the other parts of life. Intelligence is a subdomain of both life and psychology, and built on top of the other parts of both life and psychology.

Ilya Prigogine's theory of systems far from equilibrium is a good foundation for life phenomena. My goal is to further study and accumulate the knowledge and models in psychology based on Brussels-Austin group and Ilya Prigogine's theories. Once concrete enough foundation has been constructed for this middleware, we could combine the quantum theories and intelligence models.

So far, most of AI researches are based on methods of equilibrium. These approaches are difficult to make progresses in many areas. Probably people should try to re-focus AI researches on methods of far from equilibrium, rather than only on those of equilibrium.

There are some discussions of ontological aspect and epistemic aspect in Brussels-Austin approach. In real world, due to measurability, there could be several possibilities:

1) Measurable Determinism, determined by measurable factors: environment and internal states, etc.
2) Unmeasurable Determinism, determined by some factors which are not measurable.
3) Nondeterminism. With this model, there could be somethings such as free wills, etc.

Systems far from equilibrium, combined with the possibilities of measurable or unmeasurable, could be the way to illustrate the complexity of psychology and intelligence.

Based on my three-level model, the psychological concepts such as 'will' or 'free will' could be re-studied based on systems far from equilibrium. New concepts and models of intelliegnce could be proposed based on further studies.

Since life is a typical type of systems far from equilibrium, very different from other systems, Brussels-Austin group could even gain some hints from the studies based on my propsoal, to re-energize and push forward their researches.

In this proposal, there are five main points which, if no one proposed before, are my new contributions:
1) The difference between the time scale of neuron firing and excitations in microtubules and the decoherence time, does not exclude the possiblility to build psychology and intelligence models on quantum theories. Just people need build the missing middleware between them first.
2) The theories of far from equilibrium could be used as the foundation of the middleware mentioned in 1).
3) AI researches better to re-focus on methods of far from equilibrium, rather than only on those of equilibrium.
4) Brussels-Austin approach could use life phenomena as good study targets to gain hints, re-energize their efforts, and push forward the researches.
5) A three-level model for intelligence: Life, Psychology, and Intelliegnce. Psychology depends on the other parts of life. Intelligence depends on the other parts of both life and psychology.

If someone already proposed some or all of these ideas before, please let me know. I would really appreciate.