Complex systems, Scale-free networks and Affiliation networks

<div dir="ltr" style="text-align: left;" trbidi="on"><div class="MsoNormal"><span style="font-family: Verdana, sans-serif;"><br /></span></div><div class="MsoListParagraph"><br /></div><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">This post is a follow-up of the <a href="http://informationsystemsbiology.blogspot.fr/2013/12/seven-keys-for-complex-systems.html">previous one about complex systems</a>. I will further focus on the fifth point which said that efficiency in a complex system is strongly related to the capability to support information exchange flows, and will expand on the importance of <a href="http://en.wikipedia.org/wiki/Scale-free_network">Scale-free networks</a> . The importance and the size of information flows are directly related to the complexity of such systems, which is the amount of interaction between the components.<o:p></o:p></span></span></div><div class="MsoNormal"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">What makes a good information flow network for a complex system? Here are five characteristics that spring to mind: <o:p></o:p></span></span></div><div class="MsoNormal"></div><ul style="text-align: left;"><li><b style="font-family: Verdana, sans-serif; text-indent: -18pt;"><span lang="EN-US">Latency</span></b><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;"> : to minimize the time it takes from some information to travel from one subsystem to the other.</span></li><li><b style="font-family: Verdana, sans-serif; text-indent: -18pt;"><span lang="EN-US">Throughput</span></b><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;"> : to simultaneously transmit large amounts of information between all subsystems.</span></li><li><b style="font-family: Verdana, sans-serif; text-indent: -18pt;"><span lang="EN-US">Resilience</span></b><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">: to continue functioning when some subsystems or some links become unavailable.  These three characteristics are universal for all complex systems, for instance <a href="http://informationsystemsbiology.blogspot.fr/2007/02/five-challenges-for-entreprise.html">information systems</a> or <a href="http://organisationarchitecture.blogspot.fr/2008/02/mesurer-un-systme-runion.html">enterprise communication channels</a>.</span></li><li><b style="font-family: Verdana, sans-serif; text-indent: -18pt;"><span lang="EN-US">Searchability</span></b><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">: to ease the task of finding related subsystem through the exploration of the communication network. This property is related to dynamic growth and self-organization. In an <a href="http://informationsystemsbiology.blogspot.fr/2006/12/autonomic-computing.html">autonomic system</a>, automatic discovery of new features and new component is at the heart of the system’s dynamic organization.</span></li><li><b style="font-family: Verdana, sans-serif; text-indent: -18pt;"><span lang="EN-US">Cost</span></b><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">: to minimize the total weight of the communication network, whether we talk about energy, mass or dollars. Related to cost is the <b>scalability</b> of the communication network structure. Scalability means that the structure may easily evolve as the complex system grows.</span></li></ul><br /><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">To reduce latency, one must reduce the diameter of the network, which is (roughly) the average path length. The easier way is to add additional links. Similarly, to increase throughput and resilience, one must rely on path redundancy (the fact that many paths exist for routing one flow). However, there is a double trade-off: increasing the average degree and the number of edges both increases the cost and reduces <a href="http://books.google.fr/books?id=1gueFWR7qjoC&pg=PA154&lpg=PA154&dq=Kleinberg+condition+searchability&source=bl&ots=6vlHrNYrja&sig=u2plNAUPXA7UZUJYelfEgYh9vDU&hl=en&sa=X&ei=xDAGU_-dC-me0QWMwoGABg&redir_esc=y#v=onepage&q=Kleinberg%20condition%20searchability">searchability</a>. <o:p></o:p></span></span></div><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">Nature seems to have found the perfect solution for this trade-off with the <a href="http://en.wikipedia.org/wiki/Scale-free_network">scale-free network</a>structure. A scale-free network is a graph whose degree distribution follows a power law. Compared to a random graph, this means that there is a higher frequency of highly connected nodes, with large degrees. Scale-free have many wonderful properties, as explained by <a href="http://organisationarchitecture.blogspot.fr/2007/02/les-fondations-pour-ltude-des-rseaux.html">Duncan Watts</a> or <a href="http://en.wikipedia.org/wiki/Albert-L%C3%A1szl%C3%B3_Barab%C3%A1si">Albert-Laszlo Barabasi</a>. Their diameter is logarithmic in their size, and they are very resilient, that is their level of connectivity is weakly changed when some nodes become unavailable. The name “scale-free” comes from the self-similarity that the degree distribution implies. Somehow, a scale-free network may be seen as a “fractal structure”, which makes it an interesting candidate for self-growth and self-organization.<o:p></o:p></span></span></div><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="MsoNormal" style="text-align: justify;"><span style="font-family: Verdana, sans-serif;"><span lang="EN-US">What has been found in the past 20 years is that scale-free networks are everywhere, both in the nature-made complex systems (such as the network of chemical reactions within the brain), and in the human-grown systems that incorporate feedback and learning, such as the Web (network of pages) or the Internet (network of computers). Let me quote the introduction of « <a href="http://www.barabasilab.com/pubs/CCNR-ALB_Publications/200907-24_Science-Decade/200907-24_Science-Decade.pdf">Scale-Free Networks : A Decade and Beyond</a> » from Albert-Laszlo Barabasi : <i>“</i></span><i><span lang="EN-US">For decades, we tacitly assumed that the components of such complex systems as the cell, the society, or the Internet are randomly wired together. In the past decade, an avalanche of research has shown that many real networks, independent of their age, function, and scope, converge to similar architectures, a universality that allowed researchers from different disciplines to embrace network theory as a common paradigm.” </span></i><span lang="EN-US">As with any general big idea, this is an approximation of the real world, and there are some debates whether real networks have an exact power law for their degree distribution. Still, it is both a useful and powerful concept, when trying to design communication networks.<o:p></o:p></span></span></div><div class="MsoNormal"><span style="font-family: Verdana, sans-serif;"><span lang="EN-US"><br /></span></span></div><div class="MsoNormal"><span style="font-family: Verdana, sans-serif;"><span lang="EN-US"><br /></span></span></div><div class="MsoNormal"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: center;"><span style="font-family: Verdana, sans-serif;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiq9Bsq80s0g2ruUl1E94PLIBcSOVAPwMixt-cmvJTgj8BaCkNYK-V2m8jQM8ndUHetNWeqtBcTTjyDJ9J1pMeecDvWW7yV5U3BZthl0AbcETCNY2sYIQVcfMu6QhwzPfDd9xYUIN3vaU0/s1600/LinkedBarabasi.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiq9Bsq80s0g2ruUl1E94PLIBcSOVAPwMixt-cmvJTgj8BaCkNYK-V2m8jQM8ndUHetNWeqtBcTTjyDJ9J1pMeecDvWW7yV5U3BZthl0AbcETCNY2sYIQVcfMu6QhwzPfDd9xYUIN3vaU0/s1600/LinkedBarabasi.jpg" /></a></span></div><div style="text-align: justify;"><span style="font-family: Verdana, sans-serif;">I will now write a brief summary of « <a href="http://barabasilab.com/LinkedBook/">Linked</a> », a great book by Albert-Laszlo Barabasi. I have read this book many years ago, and <a href="http://organisationarchitecture.blogspot.fr/2009/11/systemes-humains-complexes-quelques.html">promised to give a review in my other blog</a>, but never found the time to do it. Still it is very relevant to what I just wrote (together with many other books which I have selected <a href="http://organisationarchitecture.blogspot.fr/2008/11/dix-ides-sur-la-structure-des-rseaux.html">in this post</a> ) since it contains a lot of details and examples about the importance of scale-free networks. The following is a short list of relevant key ideas that are well illustrated in this book, with no claim of completeness:</span></div><div style="text-align: justify;"><ul><li><span style="font-family: Verdana, sans-serif;"><span lang="EN-US" style="text-align: left; text-indent: -18pt;">The book starts with the concepts of diameter and average path length. Throughout the book, many examples are given of really large networks with small diameters. For instance, the Web  (URL network) diameter is 19. Another interesting example is the molecule interaction network in a living cell, through chemical reactions. The “diameter” is only 3 (three degrees of separation). <a href="http://arxiv.org/abs/1111.4570">Lately we have learned</a> that the diameter of Facebook social graph is 4.7.</span></span></li><li><span style="font-family: Verdana, sans-serif;"><span lang="EN-US" style="text-align: left; text-indent: -18pt;">By looking more closely at these networks, we see that the short diameter is not due to the number of edges but the presence of “connectors” (hubs), as defined by Malcom Gladwell in “<a href="http://en.wikipedia.org/wiki/The_Tipping_Point">The Tipping Point</a>” </span><span lang="EN-US" style="text-align: left; text-indent: -18pt;">J</span><span lang="EN-US" style="text-align: left; text-indent: -18pt;"> This is true for cell reactions, where a few molecules interact with many others. <a href="http://en.wikipedia.org/wiki/Small-world_network">Small-world networks</a>, as defined by Watts and Strogatz, also exhibit a higher <a href="http://en.wikipedia.org/wiki/Clustering_coefficient">clustering coefficient</a> than random graphs. These small-world structures may be thought of as small tightly connected groups, linked by connectors – hubs with high degrees.</span></span></li><li><span style="font-family: Verdana, sans-serif;"><span lang="EN-US" style="text-align: left; text-indent: -18pt;">This leads to the concept of scale-free networks, by looking at the node degree distribution law. The presence of connectors is the result of <a href="http://en.wikipedia.org/wiki/Power_law">power laws</a>, which are also called “fat tailed” because the number of nodes with very high degree is much higher than a typical “<a href="http://en.wikipedia.org/wiki/Exponential_decay">exponential decay</a>” law. Another interesting example of scale-free networks is the graph of word co-occurrence in natural language.</span></span></li><li><span style="font-family: Verdana, sans-serif;"><span lang="EN-US" style="text-align: left; text-indent: -18pt;">A good part of the book deals with how scale-free network may be grown, that is how they emerge in real life. This leads to the powerful “rich get richer” paradigm (also called <a href="http://en.wikipedia.org/wiki/Matthew_effect">the Matthew Effect</a>), where the probability of creating a new edge is proportional to the existing degree. Growth is a signature of Scale-free networks. I quote from the book : “<i>The power laws emerge – nature’s unmistakable sign that chaos is departing in favor of order. The theory of phase transitions told us loud and clear that the road from disorder to order is maintained by the powerful forces of self-organization and is paved by power laws</i>”.</span></span></li><li><span style="font-family: Verdana, sans-serif;"><span lang="EN-US" style="text-align: left; text-indent: -18pt;">A very interesting part of the book deals with resilience, with examples drawn from biology such as the protein network in our metabolism. There is an interesting comparison with hierarchical networks (such as organizational charts in a traditional company or electricity distribution network) which are less fault-tolerant than scale-free networks (even with added redundancy for the high value links). Another quote: “<i>The coexistence of robustness and vulnerability plays a key role in understanding the behavior of most complex systems. Simulations have shown that the protein network refuses to break apart under randomly generated mutations</i>.”</span></span></li><li><span style="font-family: Verdana, sans-serif;"><span style="text-align: left;">Scale-free networks are graphs, with edges between two nodes that only describe binary interactions. Most of real world complex systems use more complex “n-ary” interactions, which could be described with </span><a href="http://en.wikipedia.org/wiki/Hypergraph" style="text-align: left;">hypergraphs</a><span style="text-align: left;">, </span><a href="http://faculty.ucr.edu/~hanneman/nettext/C17_Two_mode.html" style="text-align: left;">two-mode networks</a><span style="text-align: left;"> or </span><a href="http://obssr.od.nih.gov/training_and_education/issh/2012/files/ISSH%20Affiliation%20V1.pdf" style="text-align: left;">affiliation networks</a><span style="text-align: left;">. For instance, the meetings between coworkers in a company or the chemical reaction networks are hypergraphs. A meeting is an hyper-edge since it binds many participants; a chemical reaction is also an hyper-edge in the molecule graph. It is easy to model an affiliation network with a regular bi-partite graph (just add a few nodes for the hyper-edges), so this is not a big technical difference, but </span><a href="http://research.google.com/pubs/pub35369.html" style="text-align: left;">more and more interest is given to affiliation networks</a><span style="text-align: left;"> since they are very common in the real world of complex systems.</span></span></li></ul></div><br /><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">Five years ago I decided to see if Duncan Watts’s results would also apply to Affiliation Networks. I wrote a paper entitled “<a href="http://www.researchgate.net/publication/260255723_Efficiency_of_Meetings_as_a_Communication_Channel_A_Social_Network_Analysis">Efficiency of Meetings as a Communication Channel : A Social Network Analysis</a>” which I presented at the “<a href="http://www.econbiz.de/events/event/4th-conference-on-management-social-networks-management-social-networks-dynamics-and-impacts/10009249132">Management and Social Networks</a>” conference in Geneva (2012). The main findings may be described as follows:<o:p></o:p></span></span></div><div class="MsoNormal"></div><ul style="text-align: left;"><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">I have shown that the most efficient meeting network structure relies on small meetings that have a high frequency. There is no surprise here, since this is a tenet of agile companies which are organized around daily short team meetings. Still, it is interesting to see that this is a deep structural property of the underlying network.</span></li><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">I have proposed a “latency performance indicator” that predicts the speed of information propagation as  “ #of-monthly-meetings * log(#people-that-one-wants-to-communicate with) / log(#people-that-one-actually-meets-in-a-month)”. For those mathematically inclined, one may retrieve the best practices (<i>fewer meeting, frequent meetings, a few large meetings</i>) within the formula.</span></li><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;">The most interesting piece is the emergence of a <b>small-world structure</b> as the most efficient meeting network, which is a hybrid combination of small team meetings and a few larger meetings.  This reproduces, in the case of an affiliation network, the results found ten years ago by <a href="http://www.theguardian.com/books/2003/oct/18/featuresreviews.guardianreview11">Duncan Watts</a>. It tells that companies should reproduce the diversity found in nature, implement path redundancy and combine many really small and frequent meetings such as SCRUM <a href="http://en.wikipedia.org/wiki/Stand-up_meeting">stand-up meetings</a> together with a few overlapping “town-hall” meetings (large audiences).</span></li></ul><br /><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">Scale-free networks are similar to what sociology calls “<a href="http://en.wikipedia.org/wiki/Ambidextrous_organization">ambidextrous organizations</a>”.  Ambidextrous organizations leverage the power of cliques and the strength of weak ties. The “power of cliques” is precisely the strength of team work, small group of people that are all connected to one another (hence the <a href="http://en.wikipedia.org/wiki/Clique">clique</a>name), establishing “strong ties” (which means frequent in the world of social network science). The “<a href="http://acawiki.org/The_strength_of_weak_ties">strength of weak ties</a>” is the law established by Mark Granovetter that says that we need to use our “weak ties”/extended network to get out from difficult or exceptional situations. “Weak ties” refer to people that we see rarely (as opposed to strong ties) ; the “weak ties” make the edge of our social network, they provide the diversity of viewpoint and culture which is often absent from the core of our social network (since “strong ties” tend to be very similar to ourselves).<o:p></o:p></span></span></div><div class="MsoNormal"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="MsoNormal"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjb1iTR_HSgPujEKH9aAqLns-n8-JwCbvW0ZVf9E7XtH6MagCDtg957prnnyWDOHjHk_fIayMAie46Ar1-7CtxSjrTMsMLssBU5KVmFKWwY_juObzlhKqGVmPg9pQq5xB3G8-Vf56SPkJE/s1600/Holacracy.Double_Linking.JPG" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" height="185" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjb1iTR_HSgPujEKH9aAqLns-n8-JwCbvW0ZVf9E7XtH6MagCDtg957prnnyWDOHjHk_fIayMAie46Ar1-7CtxSjrTMsMLssBU5KVmFKWwY_juObzlhKqGVmPg9pQq5xB3G8-Vf56SPkJE/s1600/Holacracy.Double_Linking.JPG" width="320" /></a></div><div class="MsoNormal" style="text-align: justify;"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;">The idea that complex systems sciences in general and social network structures in particular, are relevant to enterprise organization is becoming more and more popular (this is precisely the topic of my other <a href="http://organisationarchitecture.blogspot.fr/2012/12/organisations-excellence-et-management.html">blog</a>).  I will conclude with three examples which are closely related to this post, since those three theories attempt to improve management efficiency through a better-designed information network:<o:p></o:p></span></span></div><div class="MsoNormal"><span lang="EN-US"><span style="font-family: Verdana, sans-serif;"><br /></span></span></div><div class="MsoNormal"></div><ul style="text-align: left;"><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;"><a href="http://en.wikipedia.org/wiki/Sociocracy">Sociocracy </a> uses circles as a team structure, and <a href="http://en.wikipedia.org/wiki/Double_linking">doublelinks</a> (each intersection between circles is represented by two individuals) to implement redundant information propagation paths. The illustration is taken from <a href="http://en.wikipedia.org/wiki/File:Holacracy.Double_Linking.JPG">Wikipedia</a>.</span></li><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;"><a href="http://www.betacodex.org/">BetaCodex</a> is a management theory and practice whose claim is to “organize for complexity”. It is based on a cellular network structure, which draws its organizing principles from biology. The tree structure is replaced by a denser network of circles (with a clear reference to sociocracy), providing shorter and more resilient information propagation paths.</span></li><li><span lang="EN-US" style="font-family: Verdana, sans-serif; text-indent: -18pt;"><a href="http://en.wikipedia.org/wiki/Holacracy">Holacracy</a> is another recent management theory that draws on <a href="http://informationsystemsbiology.blogspot.fr/2013/12/seven-keys-for-complex-systems.html">complex system theory</a>. Here again we find a system of self-organizing circles (with a similar influence from sociocracy). The most defining feature of holacracy is “to organize around purpose” (cf. the fourth principle of our previous list).</span></li></ul><br /> <br /><div class="MsoNormal"><br /></div></div>

Complex systems, Scale-free networks and Affiliation networks

This post is a follow-up of the previous one about complex systems . I will further focus on the fifth point which said that efficiency in a...

Read more »