One issue that I just briefly mentioned in my last post is the choice of variables that help classify legal systems. In statistics, a variable is a measurable attribute for a sub-category of an entity. Variables should be intrinsically different from each other. Together, all variables should constitute a comprehensive representation of the entity as a whole. Continue reading What Variables Define a Legal System?
My Comments on “A Network-Based Taxonomy of the World’s Legal Systems” by Mathias Siems
Despite the (partially) fierce criticism of a quantitative approach to comparative law, the use of statistics to answer comparative law questions seems to have inspired some new comparative law research. A working paper by Mathias Siems with the title A Network-Based Taxonomy of the World’s Legal Systems uses statistics in order to “develop a difference-based taxonomy in accordance with the idea of legal families.” (p. 10)
After discussing pros and cons of classifications in comparative law, Siems comes up with three groups of four variables ranging from “English as official language” to “Paid annual leave.” He then applies these variables to a dataset of 157 countries in order to determine the difference of each single variable with the same variable for each of the remaining countries. This allows him to plot a histogram for the distribution of the country differences which in turn allows him to create and graphically represent cluster for all the 157 countries studied. Siems subsequently applies his variables to the legal origins literature concluding – somehow surprisingly – that his “network data does not support the legal origins taxonomy.” (p. 17) The last part of the paper is dedicated to developing an alternative classification of the legal systems of the world. By playing with numbers, Siems comes up with four groups: “The Global Anglosphere”, “The Modern European Legal Culture”, “The Rule by Law or Religion” and the “Weak Law in Transition”.
With his paper, Siems opens an interesting avenue for comparative law research. Statistics in general and network analysis in particular may play a role in helping to answer sometimes longstanding questions in comparative law. Yet, statistics are not inherently objective and they need to be properly applied in order to make use of their full potential. In this regard, Siems’ paper raises several concerns. First, the choice of variables by Siems – while well elaborated though probably extendable from a legal standpoint – is problematic from a statistical viewpoint as he mixes categorical variables (here questions with yes/no answers, e.g. “Islam state religion”) with ordinal (or numerical) ones (where the answer lies on a spectrum, e.g. “literacy rate”). Also, the exact translation of the variables into numbers is not really explained. Second, Siems does not really elaborate on the reasoning behind the thresholds (“cut-offs”) for his clusters. Some representations are based on a 0.11 threshold, others on 0.13. Why these thresholds were chosen remains unclear. Third, the conclusion that the classification of the legal systems according to their legal origins is wrong rests on shaky statistics. Little details are given as to the numbers and the reasoning seems somehow circular. Fourth, Siems selects the number of groups into which legal systems can be divided randomly by playing with different numbers and looking which number of groups makes more sense. This, of course, takes away a lot of objectivity from the study.
Overall, the general idea behind A Network-Based Taxonomy of the World’s Legal Systems by Mathias Siems, i.e. to examine traditional issues of comparative law is very innovative and may potentially shape future comparative law research. As any pioneering work it inevitably faces some challenges – mostly due to the fact that the statistical analysis of networks is complex and at the same time so foreign to the conventional way to think about law.
Bibliography
Mathias Siems, A Network-Based Taxonomy of the World’s Legal Systems, 2014 Working Paper Durham Law School, available here.
Can Quantification Aid the Comparative Task?
So far, we have examined cultural comparative law as a social-science-inspired methodology that may help the discipline of comparative law to accommodate modern legal developments, i.e. globalization of laws. In the next few posts, I would like to look at another relatively new comparative law method that was developed by economists: quantitative comparative law.
In the late 1990s, a group of economists (mostly known under the abbreviation LLSV) published several papers examining commercial laws of 49 countries of the world. In doing so, they used statistical tests to determine which laws are more efficient and therefore more likely to attract businesses. With this methodology, they reached the provocative result that
[…] countries whose legal rules originate in the common law tradition tend to protect investors considerably better than do countries whose laws originate in the civil law, and especially the French civil law, tradition. [LLSV 1996, p. 40]
Naturally, this conclusion and even more its inclusion in the 2004 and 2006 Doing Business reports of the World Bank have resulted in a wave of (critical) publications from (comparative) jurists, mostly from civil law countries. The main points of critique were the apparent bias towards the common law tradition (LLSV have a common law background) and the reliance on legal origins to group the legal systems of the world.
I will talk about the legal origins theory in my next post. For now, I would like to focus on the quantification as a possible methodology in comparative law. In contrast to cultural comparative law, quantitative comparative law looks at large samples of legal systems which are clustered and quantified. The use of numbers as a comparative tool, makes the comparison more objective and leads to clear-cut results. Such results, however, can be misleading in two ways: First, depending on the choice of variables, results may be biased – usually towards the legal system with which the author of the study is most familiar. Second, laws are never identical and their substitution with mere numbers may obliterate legal diversity. So while quantification may provide a valuable overview and might be an important first step in a series of comparative analysis, results should be viewed with a grain of salt and put further into perspective.
Bibliography
- Rafael La Porta et al., Law and Finance, NBER Working Paper 5661 (1996)
- Rafael La Porta et al., Legal Determinants of External Finance, 52 J. OF FINANCE 1131-1150 (1997)
- Rafael La Porta et al., Law and Finance, 106 J. POL. ECON. 1113-1155 (1998)
- Ralf Michaels, Comparative Law by Numbers? Legal Origins Thesis, Doing Business Reports, and the Silence of Traditional Comparative Law, 57 AM. J. COMP. L. 765-795 (2009)
- Catherine Valcke, The French Response to the World Bank’s Doing Business Reports, 60 UNIV. TORONTO L J 197-217 (2010)
CompareLex 