Complexity
From Freepedia
Complexity is the opposite of simplicity.
Complexity in systems or behaviour is often described as what is "on the edge of chaos" - between order and randomness.
Contents |
Study of complexity
Complexity has always been a part of our environment, and therefore many scientific fields have dealt with complex systems and phenomenon. Indeed, some would say that only what is somehow complex - what displays variation without being purely chaotic - is worthy of interest.
While this has led some fields to come up with specific definitions of complexity, there is a more recent movement to regroup observations from different fields in order to study complexity in itself, whether it appears in anthills, human brains, or stock markets.
Complex systems
- Main article: Complex systems
Systems theory has long been concerned with the study of complex systems (In recent times, complexity theory and complex systems have also been used as names of the field). These systems can be biological, economic, technological, etc.
Complex systems tend to be high-dimensional and non-linear, but may exhibit low dimensional behaviour.
Complex mechanisms
Recent development around artificial life, evolutionary computation and genetic algorithms have lead to an increasing emphasis on complexity and complex adaptive systems.
Complex simulations
In social science, the study on the emergence of macro-properties from the micro-properties, also known as macro-micro view in sociology. The topic is commonly recognized as social complexity that is often related to the use of computer simulation in social science, i.e.: computational sociology
Complex behaviour
Complex systems's behaviour is often due to emergence and self-organization
Chaos theory has investigated the sensitivity of systems to variations in initial conditions as one cause of complex behaviour.
One of the main claims in Stephen Wolfram's book A New Kind of Science is that such behaviour can be generated by simple systems, such as the rule 110 cellular automaton.
Complexity in data
In information theory, algorithmic information theory is concerned with the complexity of strings of data. Complex strings are harder to encode efficiently.
While intuition tells us that this may depend on the codec used to compress a string (a program could be theoretically created in any arbitrary language, including one in which the command "X" could mean "output '18995316'"), any two Turing-complete language can be implemented in each other, meaning that the length of two encodings in different languages will vary by at most the length of the "translation" language - which will end up being negligible for sufficiently large data strings.
It should be noted that these algorithmic measures of complexity tend to assign high values to random noise. However, those studying complex systems would not consider randomness as complexity.
Information entropy is also sometimes used in information theory as indicative of complexity.
Complexity of problems
Computational complexity theory is the study of the complexity of problems - that is, the difficulty of solving them. Problems can be classified by complexity class according to the time it takes for an algorithm to solve them as function of the problem size. For example, the travelling salesman problem can be solved in time <math>O(n^22^n)</math> (where n is the size of the network to visit).
Specific meanings
In several scientific fields, "complexity" has a specific meaning :
- In computational complexity theory, the time complexity of a problem is the number of steps that it takes to solve an instance of the problem as a function of the size of the input (usually measured in bits), using the most efficient algorithm. This allows to classify problems by complexity class (such as P, NP ... ) such analysis also exists for space, that is, the memory used by the algorithm.
- In algorithmic information theory, the Kolmogorov complexity (also called descriptive complexity or algorithmic entropy) of a string is the length of the shortest binary program which outputs that string.
- In information processing, complexity is a measure of the total number of properties transmitted by an object and detected by an observer. Such a collection of properties is often referred to as a state.
- In physical systems, complexity is a measure of the probability of the state vector of the system. This is often confused with entropy, but is a distinct analysis of the probability of the state of the system, where two distinct states are never conflated and considered equal as in statistical mechanics.
- In mathematics, Krohn-Rhodes complexity is an important topic in the study of finite semigroups and automata.
- In the sense of how complicated a problem is from the perspective of the person trying to solve it, limits of complexity are measured using a term from cognitive psychology, namely the hrair limit.
- Specified complexity is a term used in intelligent design theory, first coined by William Dembski.
- Irreducible complexity is a term used in arguments against the generally accepted theory of biological evolution, being a concept popularized by the biochemist Michael Behe.
Quotes about complexity
- "The complexity of a document is proportional to the number of fingers that you need to read it." DeMarco's Law is a paraphrase from Tom DeMarco. For example, 'The complexity of a computer program is proportional to the number of fingers you need to read it.'
- "The essence of tyranny is the denial of complexity" Jacob Burkhardt, Swiss historian.
- "Some days I will say yes, and then odd days it seems things say yes to me. And stranger still, there are those times when I become a yes." (And they are moments of the Calm) -Kevin Hart, quoted by Mark Taylor in 'The Moment of Complexity'
See also
- Complexity theory (disambiguation page)
- Important publications in complexity
- Occam's razor
- Programming Complexity
External links
- Complexity vs. Simplicity
- Quantifying Complexity Theory - classification of complex systems
- Complexity Measures - an article about the abundance of not-that-useful complexity measures.
- VisualComplexity.com - A visual exploration on mapping complex networks
