Complexity – as I see it and understand..

Introduction

There are simply many ways of viewing and understanding the subject of Complexity. It is overwhelming at times and might confuse any reasonably interested person.

As of now we have different and often differing views on Complexity. And when it comes to understanding and applying complexity in organizational settings it becomes bewildering since there is no dearth of viewpoints, perspectives, techniques, which are often in conflict to each other.

The main reason as it appears to me is that the subject of Complexity is not made up of a single body of knowledge like Physics or Maths or Economics or Philosophy. It is mix of many things. In a way it is good that it makes the discipline extremely rich but flexible at the same time. But nonetheless it can also make things a bit weird at times.

In addition the progress in the field of complexity has tended to take the ‘scientific ‘ slant trying to make things as objective as possible, usually by the help of mathematics. That puts off many who are not mathematically inclined. The reason for taking this mathematical view is not hard to understand. The development of ‘scientific management’ was started by engineers and as we all know engineers love to understand the purpose of a system through measurement, make sense of things through their calculations and then love to predict the future through their created algorithms.

Hence this practice of measure, calculate and predict has become the standard norm in understanding systems. Nothing is wrong with this rigorous approach (myself being an engineer) but at times things are taken a bit too far than necessary – forgetting the basic fact that understanding and responding to complexity is quite unlike any rigorous scientific experiment that usually deals with a few variables or parameters and examines how these variables behave under certain specific conditions (specified by us) strictly in isolation of other factors.

But the study of complexity is completely different. In fact it is just the opposite. It is complex just because there are simply too many variables/parameters playing around in a system – constantly interacting and colliding with each other like atoms and quarks to produce something new. It is an amazingly creative play.

So the study of  complexity is not about observing the movement of individual trajectories of a few variables/parameters operating under specific conditions. It is more to do with observing the trajectory of the ensemble of numerous objects, parameters and variables playing in unison and harmony under their own operating conditions –  not conditions specified by us. It is something like watching a wave rise up at the beach as if to greet us. At that time we are not even trying to see individual strands of water. Well that is impossible. We are seeing the movement of the whole wave as such where the trajectories of individual strands or strings of water combine to produce the entire wave form. In other words we are no longer interested in how a few variables/parameters will behave in different conditions. The conditions are given or as we might say self-created by the system itself – not by us.

The usual way to understand a discipline is to go through most of the theories a discipline offers, master them to a great extent and then go out and see the world with a new pair of lens to make sense of what is happening to decide as to what might then be done about it – i.e improve a situation, maintain it or destroy it.

However, my preferred way to view and understand the discipline of complexity is to turn this usual approach of mastering theories stand on its head. I have seen all systems, even similar systems differ from each other even while operating under quite similar settings. Their behavior differs, which means that every single system or part of the system that we care to observe is unique in its own way. If that be so a few simple rules, laws or theories would not be able to explain such uniqueness expressed by a complex system in variety of ways.

Therefore we would be forced to create an explanation of each system operating in its own unique conditions. This means we would not be able to apply our learned theories or any equation in a straightforward manner. Why is that? That is because of the numerous interactions that keep playing within a system. So there would be many laws, rules, principles interacting with each other to produce what a system produces. So, every time we see a new behavior we are forced to first explain it properly (as close as possible) and then possibly predict its behavior in the short-term since long-term prediction of complex system is impossible.

Hence our earlier approach to viewing the world was ‘Predict first; Explain later; only if the prediction doesn’t match the theory’. In case of complex systems it is just the reverse – ‘Explain first; Predict later, where only prediction in the short-term is allowed.’ This creates a big difference in the way we engage with our world. It means that we don’t have a set of equations to be applied uniformly and normally. The best we can possibly do is to have the data from the present behavior and then create the maths around it. That calls for mathematical thinking not mathematical prowess or great mastery of mathematical techniques.

A Question

However, my question is can we have a balanced view of complexity that might be equally appealing and easily understood by people from both science and humanities? Can it be made simple for every one to understand and apply such understanding not only in organizations but also in our everyday mundane and ordinary lives? If that is possible it would be truly useful to us. Else useless. If it could be made useful then it would not only help us adapt to changes effectively but also help us create something new and better for ourselves and the world at large.

Let us take a live case… 

To illustrate the process let us work through a case in very general terms. Presently I am exploring the complexity of system called Blast Furnace. This system is totally unpredictable. No one is quite sure what exactly is going on inside the system and when and why something would happen.

Let me explain the ‘transforming process’ that happens in a Blast Furnace. Imagine something like a big vertical stove of around 30 to 50 meters high. Hot air is admitted through the bottom of the stove. This hot air moves up the stove due to the pressure difference existing between the bottom and top of the stove (the bottom is at higher pressure than the top).  This provides the energy to the system. From the top iron ore and coke are periodically fed into the stove. This mix, called a burden, takes time (around 6 hours for a mini blast furnace) to come down slowly over a distance of say 30 meters. As it descend through the air the iron ore and coke come together to form layers of rings. Meanwhile the coke starts burning as it interacts with the hot blast air. The heat from the coke melts the iron ore which at a particular stage transforms into a liquid. This molten iron is then tapped regularly from the bottom portion of the furnace ready to be transformed into other products.

Is there something to learn from this?

From this simple description I would like to highlight six fundamental principles of Complexity, which are the following:

1) All complex systems are ‘transforming processes’, which are non-linear and dynamic. (don’t confuse the term ‘process’ with the step by step process we are generally used to in trying to achieve a desired objective). This means unless and until the system is moving it is not complex at all. Complexity arises out of movements initiated by interactions. And as you can see the process that happens within a blast furnace is a ‘transforming process’. Raw materials through various interactions are transformed into molten metal. And different materials through various interactions behave in a particular way. Moreover, material through their interactions produce different shapes.

2) Complex systems need energy to sustain itself. It is simple to understand this. Without energy there can’t be any movement. So as soon as energy flow is stopped complexity disappears. Once energy is admitted into a system the energy spreads all around forcing the different elements within and without the system to interact (even with the environment). Energy can be in different forms. Even communication between different persons within and without in an organization is a form of energy exchange that sustains complexity. Money is also a form of energy exchange sustaining complexity.

3. Interactions between different elements within a system creates complexity. And such interactions are non-linear in nature. The vortex effect arising from the interaction between coke and hot air is an example of non-linearity. Similarly the burden of coke and iron ore taking around 6 hours time to fall through a distance of say 30 meters is another example of non-linearity. This is because in normal case, if I drop a piece of iron ore from a height of 30 meters  it would take a few seconds to reach the ground. So it is fair to say that interactions and non-linearity are the driving forces in complex systems. If any one of these are absent there can’t be any complexity anywhere.

4. The elements in a complex system act in groups or ensembles. For instance the coke forming a spiral cone or the burden forming layers of rings as it descends through the furnace is an ensemble that has its own particular behavior. If it were a simple system every particle of coke would have acted as an individual having its own individual trajectory. Whereas in complex system they come together to behave as a group exhibiting group behavior. Hence we observe behavior of an ensemble not individual behavior of the interacting objects that make up the ensemble.

5. The movement within a complex system is first initiated by valid or authentic constraints. For example, the pressure difference between the top and the bottom forces the hot blast air to climb up. Similarly, the burden climbs down owing to potential difference. Likewise the hot blast air meets with a resistance as it makes its way through the spiral of coke that forms at the bottom of the furnace. Technically this is called the ‘dead man’. So long it is alive the system would work. Remove the ‘dead man’ and the system collapses in a moment. So the movement in a complex system is facilitated by Energy, Constraints and Resistance (resistance in a system is technically known as damping).

6. The shapes these interactions produce is fascinating to see and think about. The interaction of the coke with the hot blast forms a spiral cone of coke through the vortex effect. This spiral cone of coke admits or blocks the passage of hot blast in the furnace. The interaction of the air pressure with the burden not only makes the burden come down slowly over time but also forces it to aggregate as layers of rings like donuts. The spiral shape of the coke cone is also like donuts. Mathematically this shape is known as a ‘torus’.  The reason that it does so is due to the principle of ‘sync’. The materials acquire a uniform collective frequency and amplitude in a complex system.

Let’s go back to the live case… 

Now let me go back to my description of the ‘transforming process’ happening within the blast furnace.

Engineers are very wary of the blast furnace. Why so? Because it operates in peculiar and unpredictable ways. For instance the blast furnace can suddenly ‘hang’ (the burden refuses to descend any further). For for example, the quantity of molten iron that is tapped out from the furnace around every hour varies quite a lot in quantity. Or the furnace can suddenly ‘slip’, meaning that the burden suddenly accelerates its movement and comes down too quickly. It appears that it has a mind of its own. This high degree of unpredictability is simply charming to blast furnace engineers. That is why blast furnace engineers refer to a blast furnace as ‘she’ (no offence meant to women). But you get the idea quickly. No? Engineers aren’t quite sure what causes this. But the discipline of complexity can provide some answers to this vexing issue, which I shall now try to explain with six more fundamental concepts on Complexity.

What do we learn now? 

7. Small difference in the interactions produce such unpredictability. Such small difference in interactions between different elements (useful to visualize the relationship between different elements as vibrating strings) create the uncertainty in the behavior of the ensembles of various elements like the coke, burden etc. The uncertainty that happens over time in a non-linear fashion is exhibited by the formation of new patterns displaying new forms of behavior. If it were linear it would have been highly predictable. Isn’t it?

8. It is interesting to note that such differences are in the form of fluctuations and the group behavior that is displayed is also in the form of fluctuations (hence the image of a vibrating string might be helpful).  Owing to the interactions such fluctuations suddenly amplify (again a display of non-linear behavior) to create new forms and new behaviors both of which are highly unpredictable in long-term.

9. So when a complex system is operating normally, i.e no unusual behavior is observed the system can be said to be operating in equilibrium, i.e. it continues to behave the way it was behaving a moment earlier (very linear). In such a situation the fluctuations either die out or remain in a steady state situation. It implies that the damping factor or the resistance is uniformly applied on the system and there is no non-linear changes in energy content or constraints.

10. However, when the energy content or any (or all) constraint(s) in the system or the damping in the system changes the fluctuations suddenly amplify to produce complex uncertain behavior of the system. Then it is said that the system is suddenly operating away from equilibrium conditions. When this happens the system breaks the symmetry of time (where the past is not the  same as the present) to create a new behavior or a new form on its own (technically know as self-organization). Fair to say that it is the ‘difference that creates the difference’.

11. When such time symmetry is broken then something called ‘bifurcation’ occurs. In plain language it means the system opens up two possible paths to proceed. But what path it cares to take is not known or can be predicted in advance with any degree of accuracy. The system ‘chooses’ the path. Do we have an example of this in our description of the blast furnace? See that the furnace can either ‘hang’ or ‘slip’. These are the two possible paths that are available to the system. What path it would take and why it cares to do so is not know. It is completely up to the system’s ‘collective and contextual intelligence’ to decide the path it prefers to take. Certainly this is out of human control. I love the associated philosophical meaning. While dealing with complex systems human beings have no control. It is much like what keeps happening within our own bodies and minds. We can also see enough examples of that happening in Nature. Enough to say that it is ubiquitous.

12. We may conclude that all non-linear dynamic complex transforming processes are very creative and are highly intelligent.  It possibly helps us to realize that the causes of complexity lie within the dynamics of the system. They are neither outside the system nor separated by time and space.

Is there a simple way to negotiate complexity?

But how do we deal with such complex systems? It is clear that we can’t force our way through complex systems or make it behave the way we like. A possible way that appears to me is to befriend a complex system, listen to what it wants to do and then take creative measures to make it flow in our desired direction or decide to flow with the system (adaptation) or create new directions (creation).

The possible path to effortlessly flow along with any complex system might be stated in a simple way, which is as follows.

a) Pay close attention to the changes in behavior of the system.

b) Pay close attention to the difference in the fluctuations arising from the numerous interactions that go on in a complex system to note when these die out or when they amplify.

c) Change/Re-design, Maintain, Destroy the Energy content of the system, Constraints of the System or Damping of the system. These are the only ways to play with any creative, intelligent complex systems.

It hardly matters whether we approach a complex system through qualitative understanding or through quantitative mathematical techniques. It is all the same. But while trying to tackle through quantitative techniques it is useful to remember that we don’t start with an equation and then apply it to predict as to what might happen. We start by observing the changes in behavior and difference in fluctuations and then form necessary equations and algorithms to explain and predict in the short-term.

These 12 principles can be applied to any complex system with ease.

Conclusion

To conclude Complex Creative Systems is philosophically very appealing to me. Human beings are always in search of meaning, purpose and prediction. I believe that we do so since it is our innate nature to transcend our small self in order to reach the infinite to be joyful and happy.

For this, we have tended to look at the past to find causes. Or we have projected our mind to see the future, however dimly. Then we have tried breaking down parts of the system (reductionist method) to create meaning. Or we have tried hard looking at the whole (holistic) to find the purpose.  Both approaches are frustrating and stressful to say the least when we use them to deal with complex systems.

Understanding of Complex Creative Processes offers us a new way — to be in the present moment and be there. It is the place where the past, the present and the future converge and meld into one. It transcends both reductionist and holistic approach simply by paying attention to the given moment. That is happiness in the true sense of the word. The ability to do something worthwhile from that sets us free to change ourselves and possibly the world. The future is unknowable but at the same time can be created. Isn’t that powerful?

I agree with the Upanishads, ‘You are That!”

References:

1. End of Certainty by Ilya Prigogine

2. Web of Life by Fritjof Capra

3. Sadhana by Rabindranath Tagore (Tagore Omnibus)

4. Complexity and Management by Ralph D. Stacey and others..

Note:

If you are interested in understanding the approach to flow with complex systems you might like to go through another post of mine, which is ‘How to Embrace Complex Systems with a Smile’ http://wp.me/p2CS2f-A

Advertisements

4 thoughts on “Complexity – as I see it and understand..

    1. Sorry I did not notice you comment any earlier. Thank you so much for your comment. It would be great to discuss a Nemetics Institute as part of our EmergentU initiative. Look forward to the proposed dialog. How would you like to take it forward?

      Like

  1. Pingback: A Letter about Complexity « MetaCogs

    1. Dear Daniel,

      You really write well enough.

      Frankly I think you have committed the classic error of forced ‘associative thinking’ (refer Thinking Fast; Thinking Slow by Daniel Khaneman).

      Anyway, good luck to your learning and ‘bending spoons’. There are many ways to meditate. The way does not matter so long we are able to lose everthing to gain clear insights. All ways are OK.

      Sincerely
      Dibyendu

      Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s