There’s strong phenomenological evidence that organisations are much greater than the sum of their parts. In fact, in any well-managed company you have people that can build but can’t manage or sell, people that can sell but can’t manage, and people that can manage but can’t build or sell. In spite of this, psychologists have until very recently focused on black-box theories of ’individual’ intelligence whose value and credibility is often exaggerated.
Now, if the value of a scientific theory of collective intelligence is obvious why haven’t scientists done much to develop such a theory? This is exactly the question I’d like to address in this essay.
It might be instructive to look at what good universities have done so far. MIT has a center for Collective Intelligence but their handbook doesn’t go beyond interesting case studies and gather theories developed by researchers in other fields(ex. Adaptive Market Hypothesis) and place all of this under the umbrella term of collective intelligence. They are very far from a scientific theory that can make quantitative predictions of the performance of an arbitrary organisation. However, I’d like to show that this is probably not due to any lack of ability. Any theory of collective intelligence faces three very important obstacles that makes it difficult to develop a theory that has predictive power.
These difficulties are the following:
- combinatorial difficulties: A theory of collective intelligence that would be applicable to human organisations faces structural challenges that don’t apply to theories that concern individuals. Let’s suppose you have a group of size 40 and you’d like to evaluate the ’individual’ intelligence of each member, then there’s only one structural way of doing this. You place each individual in the same reward-summable environment and observe their performance.But, if you choose to divide them into groups of size , you have ways of doing this. This creates a lot of options for a scientist that doesn’t have a clue what they’re doing. If we let this means 91 390 options.Now, from the youngest age students in school are made to believe that they are competing with each other. Parents and teachers pit their pupils against each other and the grades they get are supposed to reflect their ‘brilliance’.
If on the contrary, there was solid evidence that the ability to cooperate and coordinate tasks was more important than the ability to compete we might observe more constructive behaviour. But, as the combinatorial problem illustrates, it might be that what is truly important is difficult to measure. In fact, the combinatorial difficulty is only the first difficulty.
- Longitudinal difficulties: Theories of individual intelligence can be assessed in the ’wild’ as an individual remains an individual throughout their life so you can note how their income, life expectancy…etc. might be correlated with the ’intelligence’ tests that you gave them years ago. However, a group of size is not guaranteed to exist even in the near future.
- Laboratory-assessable tasks: The classification of laboratory-assessable tasks is an important difficulty facing any scientific theory of behaviour. What experiments should be done to examine particular behaviours that are observed in the ‘wild’?The problem is evident when one begins to think about the feedback loop which determines whether a set of experiments actually has strong predictive value. Given the difficulty of performing longitudinal studies such a feedback loop is virtually non-existent . Not only would a scientist find it difficult to reproduce their research but the importance and range of validity of their research would be questionable from the beginning.
It might still be possible to develop a scientific theory of collective intelligence however the difficulties presented in this essay suggest a general theory might be very difficult to develop. So far psychologists have developed theories of individual intelligence that have contributed to research on cognitive ageing and development. However, the findings in this field have also been regularly overstated which has led to divisions along sexual and racial lines.
In an increasingly networked world, I think it’s definitely time that researchers from various fields(ex. network theory, mathematics, statistical physics…etc.) try to address the mystery of collective intelligence. We have yet to reach a holistic understanding of intelligence that will help us further our goals as a civilisation.
Relevant sources of information:
1. Cambridge Handbook of Intelligence(2011)
2. A Formal Measure of Machine Intelligence(Shane Legg et al.)
3. Handbook of Collective Intelligence(Thomas W. Malone et al.)
Note: I decided to clarify certain sections after receiving comments from a friend.