Tuesday 1 February 2011

20 questions for Richard Wilkinson & Kate Pickett

[Wilkinson and Pickett (W & P) have now responded to these questions. This post has been updated to show their answers, with my replies below. These are a set of straight-forward questions on simple points of fact that were raised on this blog in April 2010. Some websites have portrayed W & P's replies as being a response to the evidence and arguments in the book The Spirit Level Delusion. They're not. They have never responded to those, but their replies here are of interest all the same.]


1. Why do you exclude the Czech Republic, South Korea and Hong Kong from your analysis when all these societies are wealthier than Portugal?

Wilkinson & Pickett: There are different ways of measuring average income in different countries; the choice of measure makes small differences in precise ranking of countries by wealth. We chose countries ordered according to the Atlas Method, because this is used by the World Bank to classify countries into Low, Medium and High Income categories. Our source is the World Development Indicators Database, World Bank, April 2004*. From this list we selected the 50 richest countries, excluded those with populations less than 3 million and those without income inequality data from the United Nations. Our aim was to examine the impact of inequality on health and social problems among rich countries, where average levels of income are not related to health, happiness or well-being. Our selection criteria also mean that we only consider the older, rich, developed, market economies, and so allows us to compare like with like. The countries which our critics suggest we should fail to meet the criteria.

This is a key question and unfortunately W & P only reiterate what they said in the Appendix of The Spirit Level. I have never challenged their assertion that only wealthy Western industrialised nations should be included in the analysis. The question is which countries are "rich". Any cut-off point will be open to debate, but picking the top 50 for no other reason than that it is a round number is unnecessarily arbitrary.

W & P say that they selected the countries by picking those which appeared "on the flat part of the curve at the top right in Figure 1.1 on p. 7, where life expectancy is no longer related to differences in Gross National Income" (The Spirit Level, p. 280). This is simply not true. The image below is a close up of the countries in Figure 1.1. Hungary, the Czech Republic, Slovenia and South Korea (Hong Kong is not shown) are all on "the flat part" and are all shown as being richer than Portugal and yet they are not included.




All I do in The Spirit Level Delusion is include countries of similar or greater wealth that should—by W & P's own criteria—have been included in the first place. I have not added poorer countries in, rather I have included rich developed societies that W & P excluded without good reason.

The World Bank gives figures for the Atlas method (in US dollars) and Purchasing Power Parity (in international dollars). The latter is more appropriate for international comparisons—the whole point of international dollars is to facilitate international comparisons. Even using W & P's arbitrary top 50 cut-off point, the World Bank's figures for 2005 show:

(9) Hong Kong: $34,900
(45) Slovenia: $22,140
(46) South Korea: $22,010
(48) Portugal: $22,070
(50) Czech Republic: $19,560

And the figures for 2008 show:

(16) Hong Kong: $43,960
(44) South Korea: $28,120
(46) Slovenia: $26,910
(55) Czech Republic: $22,790
(59) Portugal: $22,080

Whichever data set is used, there is no justification for including relatively poor countries like Greece and Portugal while excluding several nations which are manifestly comparable.

If we wish to "compare like with like", it is particularly important to include Asian countries other than Japan, because they demonstrate that the supposed benefits of Japanese equality are actually the result of social and cultural factors unique to Asian societies. Although very unequal, Hong Kong and Singapore perform well under almost every criteria although the W & P hypothesis predicts that they should perform worst. This reveals a puzzling lack of a dose-response relationship.


[*Although published in 2004, the figures refer to 2002 - CJS]


2. Why do you exclude Singapore from your graph of mental illness when you included it in the same graph when it was published in Olivers James' Affluenza?

Wilkinson & Pickett: Comparing the prevalence of mental illness in different societies has long been thought to be problematic because of cultural differences in labelling mental illness or in help-seeking behaviours. To overcome these limitations, the World Health Organization established a consortium to provide international comparisons of the prevalence of mental illness. As referenced in The Spirit Level, we use these WHO estimates for Belgium, France, Germany, Italy, the Netherlands, Spain and the USA. We added in estimates from Canada, the UK and Australia because they used almost exactly comparable methods (diagnostic interviews of random samples of the population) to the WHO studies. We did not include a survey of mental illness from Singapore in either of our peer-reviewed publications on this topic, or in The Spirit Level, because the WHO surveys included questions on illegal drug abuse and, in 1988, the death sentence became mandatory in Singapore for manufacturing, importing, exporting or trafficking drugs in small quantities. Possession of small quantities was taken as prima facie evidence of trafficking. We therefore consider that self-reported estimates of mental illness in Singapore survey will be under-estimates. However, even if Singapore is included, there is still a statistically significant association between income inequality and mental illness (r=0.58, p=0.04).

This doesn't answer the question of why they included Singapore in the graph they created for Affluenza and The Selfish Capitalist. Drugs are illegal in all the countries studied in their graph and admitting to having used a substance in a confidential mental health questionnaire is not grounds for prosecution for possession, regardless of the severity of the punishment.

Rates of anxiety and mood disorders found in the Singapore study indicate that the position of Singapore in the Affluenza graph is about right (ie. about the same as France).

We will come back to the reliability of their mental illness graph in question 14.


3. Why do you say that the USA’s decline in homicide ended in 2005 when 2008 saw the lowest number of homicides since 1965? As you must know, America's murder rate has halved in the last two decades despite rising inequality.

Wilkinson & Pickett: We started writing The Spirit Level in January 2007 and delivered it to our publisher in February 2008, so clearly we could not have accessed homicide data from 2008 – typically official statistics are published 2-3 years post-collection. At time of writing (mid-2010), the most up-to-date data are for 2008.


The homicide rate in the USA has indeed declined, on average over the past two decades, whilst income inequality has been rising. But, as we discuss in The Spirit Level, and show here, there is a match over time between bottom-sensitive measures of income inequality and changes in homicide rates.

The Spirit Level contains references to several articles published after February 2008, but we shall let that pass. On this occasion, I accept that my criticism was too hasty. I accept that W & P would not have had the homicide data for 2008 before The Spirit Level was published in hardback. Presumably they will correct their claim that the murder rate started to rise again in 2005 in the future editions?*

The substantive point remains, however. America's murder rate is at its lowest level since 1965 and it was very premature for W & P to suggest that the 2005-06 blip represented the start of an upward trend. This seems a small point but it important to their overall argument. The reason W & P are so keen to claim that the murder rate began rising in the 2000s is that the huge decline in American homicide coincided with growing equality. The sharp but inconvenient decline in the murder rate (and of crime generally) from the early 1990s does not sit easily with their theory that inequality is the root cause of homicide. As shown in The Spirit Level Delusion and elsewhere, W & P's evidence for linking the two is extremely tenuous.



* (UPDATE 2011: The second edition has appeared and they have not.)


4. Why did you use older data for your life expectancy/inequality graph than you used elsewhere in The Spirit Level? Is it because more recent data show no correlation with inequality?

Wilkinson & Pickett: To avoid the effects of random fluctuations in inequality measures in each country, we took the average of inequality measures published in four consecutive years of the UN Human Development Report. We then matched outcome data (including life expectancy) as nearly as possible to the same time frame as the measures of inequality. When looking at life expectancy against National Income per head we again took the most up to date measures of those covering the same time frame. There are also many recent studies that demonstrate a relationship between income inequality and health, see for example the study of more than 60 million individuals by Kondo and colleagues.

This simply doesn't make any sense. W & P's national income data come from 2002, therefore it is logical to use life expectancy data from 2002. Instead they use data from 2004 (as published in the UN Human Development Report (UN HDR) 2006).

But when they look at inequality, they use life expectancy figures from 2002 (as published in the UN HDR 2004), even though their inequality figures are averaged out from several different years. A better explanation is that the older edition of the report was preferred because it provided slightly better evidence of a correlation between inequality and longevity, albeit only when W & P's selection of countries were used.

I am by no means the first person to have spotted Richard Wilkinson's tendency to be choosy about which sets of data he uses to make his case:

"He [Wilkinson] gives no satisfactory explanation about why "the poorest 70%" should be chosen, and the suspicion must be that the choise is derived from the data."

Ken Judge, 'Income distribution and life expectancy: a critical appraisal', British Medical Journal, 1995

"The strength of association between absolute income and life expectancy seems quite sensitive to which countries are included. What constitutes an appropriate set of countries of this sort is certainly open to debate. Nevertheless, we have shown that compared with Wilkinson's selection of 23 countries, the addition of the other 10 equally wealthy nations that constitute the full sample, significantly changes the results."

J. Lynch, P. Due, C. Muntaner & G. Davey Smith, 'Social capital - Is it a good investment strategy for public health?', Journal of Epidemiological and Community Health, 2000

"Although many aspects of this debate are still unresolved, it has recently become clear that the findings of that paper [Wilkinson, BMJ, 1992] were an artifact of the selection of countries... the evidence for a correlation between income inequality and the health of the population is slowly dissipating’

Johan Mackenbach, 'Income inequality and population health', British Medical Journal, 2002

W & P also mention the study by Kondo et al., published in the BMJ in 2009. They have a particular fondness for this study, which measured self-reported health. They cited it during the Royal Society of Arts debate and referenced it in their response to Peter Saunders. They also mentioned it in their response to an article I co-authored in the Wall Street Journal. In the latter, they insisted that it "shows unequivocally that inequality is related to significantly higher mortality rates."

In fact, the study concludes that:

The results suggest a modest adverse effect of income inequality on health, although the population impact might be larger if the association is truly causal... The findings need to be interpreted with caution given the heterogeneity between studies

This paper certainly gives more support to W & P's hypothesis than most, but it is anything but unequivocal.


5. You use the high rate of teen births in Portugal (in 2002) as proof that inequality is related to teen births. Why do you not mention that abortion was illegal in Portugal until 2007?

Wilkinson & Pickett: We do indeed show that teenage births are related to income inequality in rich countries, as have UNICEF. This is not dependent on Portugal; indeed if we exclude Portugal the relationship with inequality is slightly stronger, not weaker. In the USA, unlike internationally, data on teenage conceptions were available so we use those, rather than births, as they are unaffected by state differences in access to abortion, and we show the same robust relationship with inequality.

The relationship is not stronger without Portugal. Nor could it be, since Portugal is an unequal country with a high rate of teen birth (primarily the result of its high rate of teen marriages and low abortion rate). With Portugal dropped from the analysis, the r-squared drops from an already feeble 0.10 to 0.089.

I do not suggest that the correlation is dependent on Portugal, only that a ban on abortion is going to have a major effect on the birth rate and is an example of the kind of real-world differences that are routinely ignored in The Spirit Level. Throughout The Spirit Level, W & P refuse to acknowledge social, demographic, historical and cultural differences between nations unless those differences can be used to plug gaps in the theory.

For example, when Finland is seen to have a high rate of homicide, they are quick to point out that it has a high level of gun ownership, but, absurdly, they do not give the same benefit of the doubt to (unequal) places like Israel and the United States.

In the case of Portugal, two major, common sense explanations for the high level of teen births are staring them in the face (the other being Portugal's high rate of teen marriages) but since the high Portuguese figure superficially supports their hypothesis, these confounding factors are never acknowledged.

As I acknowledge in The Spirit Level Delusion, the UNICEF report mentions inequality as one possible explanation for teen births but it makes it clear that it is not the primary cause. As Peter Saunders has shown, English speaking countries tend to have higher teen births. The UNICEF document makes it clear that cultural differences provide a better explanation for teen birth rates than inequality. The low rates of teen births in Singapore and Hong Kong (not shown in The Spirit Level) give further support for this, as does the fact that the only non-Anglo nation with a higher rate of teen births is Portugal for the reasons given above.


6. Why do you not include the crime rate in your index of health and social problems? Is it because the crime rate tends to be higher in 'more equal' countries?

Wilkinson & Pickett: It has often been pointed out that homicides are one of the few crimes which can be compared reliably between countries. Comparisons of other kinds of crime are affected by differences in the law, in reporting, and by other extraneous influences. Car crime, for instance, is affected by the number of cars  and rape is dramatically affected by reporting (see our answer to Q 19 below. While there are some research papers showing relationships between inequality and property crime, there are no sources of data (including those used by Snowdon) which deal adequately with these problems. Hence, we confined our attention to adult and juvenile homicide rates. There are more than 50 studies showing that inequality is related to violence, see for example the review by Hsieh and Pugh 25 and the recent study by Elgar and Aitken.

I mention the potential pitfalls of comparing recorded crime data in The Spirit Level Delusion, which is why I also show the results of the EU Crime Survey. The Crime Survey uses the same methodology for all countries and is based on people's experience of crime, whether recorded or not. Both data sets indicate higher levels of crime—particularly property crime—in more equal societies.


7. Why do you say that homicide is inversely related to suicide when there is no evidence for this?

Wilkinson & Pickett: In fact, there are several pieces of research which show that homicide rates are inversely related to suicide, see for example (44) (45)

Having spent so long fact-checking The Spirit Level, it came as no great surprise when I turned to the first study referenced by W & P and found that its conclusion read:

The overall correlation between homicide and suicide rates was weak and statistically insignificant

It is certainly true that homicide rates are higher in Africa and the Americas (this is confirmed in the second study they reference—see below), while suicide rates are higher in Europe.




Perhaps W & P would argue that this graph shows that suicide is inversely associated with homicide. I think most people would say that it shows that there is simply a much higher homicide rate in Africa and the Americas. There is reason to believe that rising prosperity leads to lower homicide rates and higher suicide rates. But when we compare the wealthy countries that are the focus of The Spirit Level, there is no correlation between suicide and homicide (see The Spirit Level Delusion, p. 82).


8. Why do you suggest that people in more equal countries give more to charity when the reverse is true?

Wilkinson & Pickett: We do not say that people in more equal countries give more to charity - instead we show that more equal countries donate more in development aid to foreign countries. We do cite Eric Uslaner’s work which shows that people who have high levels of trust are more charitable. Snowdon presents data from the Charities Aid Foundation, which suggests that more unequal countries (especially the USA) have higher levels of individual charitable giving. However, as the Charities Aid Foundation points out, charitable giving in the USA is heavily influenced by tax policy, and may also be a response to the exceptional need created by the US lack of social security systems. Only 3% of US charitable giving goes overseas, so total US donations to overseas development are substantially lower than other rich countries.


Low levels of US government aid are partly a reflection of low trust in government (strongly related to inequality) and also of a lack of social security and welfare provision. Together these shift the onus of support to wholly inadequate private charitable giving.

On page 60 of The Spirit Level, Wilkinson and Pickett write that:

"Not surprisingly, just as individuals who trust other people are more likely to give to charity, more equal countries are also more generous to poorer countries."

Bearing in mind that, at this point in the book, W & P have just 'proved' that people in egalitarian societies are more trusting of other people, how else is the reader supposed to interpret this sentence, other than as a claim that people in more equal countries give more to charity?

But they don't. They give less to charity, for reasons that are well-understood. The Charities Aid Foundation (CAF) certainly does point out that the USA's tax system encourages donations to charity. Are Wilkinson and Pickett suggesting that this is a bad thing? It seems that way. (nb. Only Sweden, Finland and Austria do not incentivise charitable giving).

The CAF also notes that people in high-tax countries are less likely to give to charity. This is hardly surprising, since people are less likely to give to charity if (a) they have less disposable income, and (b) they live in a society which expects the state to take responsibility for such matters. I address both issues in my book and quote the CAF.

Wilkinson and Pickett reveal their political bias with their dismissive attitude towards voluntary, private charity and their preference for publicly funded, compulsory aid. They are fundamentally wrong about all their assumptions given above. Low levels of government aid are not a response to lack of trust in government—the government decides the level, after all. Instead, they are the result of lower levels of taxation and a historical emphasis on private philanthropy. W & P are also wrong to say that total US aid (private + public) is "substantially lower" than that of other countries. The USA is consistently in the top 10 in both per capita terms and in absolute terms.

And they are wildly wrong when they make the unreferenced claim that only 3% of US donations goes overseas. This is just the kind of causal disregard for the truth that makes fact-checking The Spirit Level such an exhausting affair. Of the $307 billion the US gave to charity privately in 2008, $116 billion went overseas. That is 38%, not 3%. And while Americans prefer private donations to state-funded aid, the USA gives far more than 0.7% of its GDP to the developing world. (0.7% being the United Nations target.)


9. Why did Kate make a video called ‘Why Cubans live longer than Americans?’ when all the sources show that life expectancy in Cuba is lower than in the USA?

Wilkinson & Pickett: Kate was not consulted about the title for this online clip from a short interview. What she actually said was that countries such as Cuba, Costa Rica and some poorer European countries have life expectancy as high, or higher than, the USA. In fact, in the 2006 revision of the United Nations World Population Prospects report, for 2005-2010, infant mortality rates in Cuba were 5.1 per 1000 live births, compared to 6.3 for the United States, and life expectancy was in Cuba was 78.3 years, compared to 78.2 years in the USA.

It is difficult to believe that Pickett would have no say about the title of a video she presented, or would have no power to rename or withdraw the video once it was given a misleading title. But whoever named it can hardly be blamed, since she does indeed claim that Cuba and Costa Rica have life expectancies that are "as high or higher than the United States."

W & P's reference to the World Population Prospects report is another example of their habit of data-mining to find the 'right' figures. As they must know, that particular report gives a prediction, it is not a real figure. More reliable figures for life expectancy come from the UN HDR—the preferred source used in The Spirit Level. All of these reports show life expectancy being higher in the USA than in Cuba and Costa Rica. The most recent edition shows that life expectancy is 79.1 in the USA and 78.5 in Cuba. Costa Rica's life expectancy is 78.7.


10. Why do you write about "increased family break-down and family stress in less equal countries" when divorce and single-parent households tend to be more common in more equal countries?

Wilkinson & Pickett: Although lone parent families are not more common in more unequal countries, changes in income inequality are correlated with rising divorce rates in US counties.

This evades the question. The facts show that divorce is more common in more equal countries, and the Scandinavian countries have amongst the highest rates of lone parent families (as do some Anglo-Saxon countries). It is simply untrue to say that there is "increased family break-down and family stress in less equal countries".


11. Why do you say that community life is weaker in less equal countries when these nations have more people involved in community organisations (charities, sports clubs, environmental groups etc.)?

Wilkinson & Pickett: Robert Putnam’s measures of ‘Social Capital’ are based on membership of voluntary and community associations of the kind you mention. Both in his earlier study of the Italian regions and in his study of the American states he shows there is a very strong tendency for the more equal regions and states to have stronger community ties measured in this way. Looking at changes over time in the US as a whole he also says:


"Community and equality are mutually reinforcing... Social capital and economic inequality moved in tandem through most of the twentieth century. In terms of the distribution of wealth and income, America in the 1950s and 1960s was more egalitarian than it had been in more than a century. ...those same decades were also the high point of social connectedness and civic engagement. Record highs in equality and social capital coincided. Conversely, the last third of the twentieth century was a time of growing inequality and eroding social capital. By the end of the twentieth century the gap between rich and poor in the US had been increasing for nearly three decades, the longest sustained increase in inequality for at least a century. The timing of the two trends is striking: somewhere around 1965-70 America reversed course and started becoming both less just economically and less well connected socially and politically." p.359


Sociologists distinguish between generalized trust (trust of people with whom we do not have an intimate relationships) and particularized trust (trust of people like ourselves). Generalized trust is related to social capital, and many researchers, including Putnam, have linked these measures of social capital to greater equality. Indeed, they have shown that it is inequality that affects trust, rather than the other way round.

Again, this does not answer the question. The international evidence shows that people in less equal countries are more likely to be members of clubs, societies, sports associations, religious groups etc. The only exception is trade union membership, which is often compulsory or strongly 'encouraged'. The graph below shows data from the World Values Survey.



What Putnam shows is that membership of these kinds of groups has declined in the United States over the last fifty years (as it has elsewhere). But Putnam never endorses the theory that inequality is the cause of the decline in club membership or social capital.

Indeed, W & P's selective quoting from Putnam's Bowling Alone is a good example of how they provide the illusion of an academic consensus where none exists. In The Spirit Level, they quote the same passage as the one quoted above, with the same sections deleted. The unwary reader might interpret this quote as evidence that Putnam believes that inequality leads to less social capital.

But, as ever with W & P, it is what they do not show that is most instructive. The unabridged first line of this quote reads: "Community and equality are mutually reinforcing, not mutually incompatible." After the last line W & P quote, Putnam concludes: "This pair of trends illustrates that fraternity and equality are complementary, not warring values."

As these words suggest, Putnam is not arguing that income equality necessarily increases social capital, he is merely arguing that the former does not damage the latter. This is obvious from the section heading which asks the question: 'Is social capital at war with equality?'

Why would he ask that question? Because, as Putnam points out: "the abundant social capital of the 1950s was often exclusionary along racial and gender and class lines. Generally speaking the haves engage in much more civic activity than the have-nots." Because of this, it is sometimes argued that left-wing attacks on elitist social institutions weaken some forms of community life. Putnam argues that these fears are ill-founded, and he says the positive correlation between equality and social capital in the USA since the Second World War "powerfully contradicts the view that community engagement must necessarily amplify inequality."

But Putnam is far more cautious in claiming a causal link between income equality and social capital than W & P. In fact, this brief passage is the only part of his 500 page book that evens mentions income equality (R. Putnam, Bowling Alone, 2000; pp. 358-60). When he sums up the evidence to explain why community life has broken down in the USA since the 1950s, he identifies four factors ('generational change', 'television', 'work' and 'sprawl' - p. 284). He does not include inequality.


12. Do you accept that the World Values Survey data show no correlation between 'happiness' and inequality, but a strong correlation between 'happiness' and income?

[There are so many points to make about W & P's answer here that I have split it up]

Wilkinson & Pickett: We accept that there is no relation between inequality and WVS measures of happiness, but among the rich countries neither is there a relation between happiness and Gross National Income per head (see our figure 1.2 in The Spirit Level).

W & P's claim that there is no relationship between happiness (as measured by the World Values Survey) and Gross National Income is incorrect. As can be seen from the graph below, there is a clear correlation, even at a very high level of economic development.




W & P never show this graph. Instead, they use a graph that shows rich and poor countries together (Spirit Level, p. 9), which obscures what is shown above. Consequently, they are able to begin their book by claiming that "happiness levels fail to rise further as rich countries get still richer". This is a crucial part of their argument, since it suggests that economic growth has "done its work"and can therefore be curtailed. It is, however, factually incorrect.

The other important thing about the happiness surveys is that they show no relationship with inequality. This is a crucial observation, since it is powerful evidence that more equal societies are not happier.




During the Royal Society of Arts debate, Richard Wilkinson responded to this evidence by claiming that happiness does not have a social gradient and, therefore, would not be affected by levels of inequality. This is not true. Any number of studies have shown that the rich are happier than the poor eg. Easterlin (1974). They have, however, now acknowledged this...

In our debate at the RSA, Richard meant to say that happiness and income have a reverse social gradient, rather than no social gradient. The correlation between income and happiness among individuals within countries has been shown to be a relationship with relative income and social status. 


The correction is welcome* but the subsequent argument is weak. There are many reasons why the rich are happier than the poor. In part, their absolute income allows them to afford a better standard of living and, in part, their relative income allows them to compare themselves favourably to their peers. While both are important, the material benefits of absolute income receive short shrift in The Spirit Level. W & P focus only on relative income and claim that richer people are happier only because money buys status and status symbols. This is opinion, not fact.

It has also been shown that additional income makes much more difference to the happiness of the poor than the rich. This would suggest that redistribution would improve over-all happiness. 


No. It suggests that additional income would improve the happiness of the poor. We should, therefore, pursue a system that will maximise increases in the incomes of the poor. There is no evidence that the zero-growth egalitarianism proposed by W & P will do that.

But the key argument in The Spirit Level is that the poor would become happier if the rich become poorer, even if the poor got no richer in the process. In other words, rounding up and deporting every millionaire in Britain would, in itself, be enough to improve social outcomes, even if no one got richer as a result. This is where W & P depart from the bulk of the scientific literature and, I would argue, from common sense.

Several economists who study happiness (e.g. Blanchflower and Oswald) show that, in sub-national analyses, more equal societies, for example more equal US states, are happier. 


The majority of happiness studies have shown that inequality has no effect on happiness, which is why the happiness studies are not mentioned in The Spirit Level. (See, for example, reviews by Clark and Senik (2010) and Hopkins (2008).) Nor do Blanchflower and Oswald say that more equal states or countries are happier. This is a complete misrepresentation of the literature.


International comparisons of subjective variables, such as happiness, are notoriously unreliable (for example, self-reported health appears better in countries with higher death rates) This is why in The Spirit Level we concentrated very largely on objective measures of health and wellbeing.



Since the happiness surveys show no correlation with inequality and a strong correlation with income, it is perhaps unsurprising that W & P now choose to distance themselves from them. It is a shame they felt the need to put this "notoriously unreliable" data at the heart of the first chapter of their book. Note also, that the trust survey—upon which they base so many of their arguments—is a wholly subjective and self-reported measure. They also put great faith in the Kondo study (see question 4) which studies self-reported health.


[*A "reverse social gradient" implies a reverse relationship ie. that the poor are happier. Since even W & P cannot believe this (surely?), I assume this to be a slip of the pen.]


13. On page 19 of The Spirit Level, you say you included alcohol addiction as a 'health and social problem', but you never discuss it in the rest of the book. Is this because the highest rates of alcoholism are in Scandinavia?

Wilkinson & Pickett: It is important to distinguish between alcohol use and alcohol abuse. Alcohol use is difficult to measure and often has no social gradient – consumption tends to be higher in higher social classes. This is in marked contrast to binge and problem drinking. We include alcohol abuse (as measured by surveys of mental illness that cover drug and alcohol addiction) in our Index of Health and Social Problems, and have previously demonstrated a significant relationship between deaths from alcohol-related liver disease and income inequality in US states.

I agree about making a distinction between per capita alcohol consumption and overall alcohol consumption, but several international surveys of mental illness surveys have shown that the more equal Scandinavian countries have the highest levels of alcohol abuse. It would be interesting to see what W & P's alcohol abuse graph looks like. It does not appear in The Spirit Level and the data is not included in their spreadsheet.


14. Why do you show no data about the (high) prevalence of mental illness in Scandinavia?

Wilkinson & Pickett: The World Health Organization has not yet produced internationally comparable data on mental illness for Scandinavian countries, but we eagerly await such data. In the absence of robust estimates from the WHO, we know of no high quality data to justify the suggestion that Scandinavian countries have a higher prevalence of mental illness.

W & P's mental illness graph provides one of the most egregious examples of data-mining in The Spirit Level. Much more evidence for mental illness prevalence exists than is shown in The Spirit Level and, although W & P are implying otherwise, they do not confine themselves to "robust estimates from the WHO". The figures they use for the UK, Australia, New Zealand and Canada (all less equal countries) come from other sources. When more than one source is available, W & P consistently pick the figure that best suits their hypothesis. As I explain in The Spirit Level Delusion, there are serious questions about the reliability of some of the figures from the WHO study, which the study's authors acknowledge.

I don't claim that rates of mental illness are necessarily "higher" in Scandinavia, but the available evidence suggests that they are as high as in the United States. For example, a large study of all four Nordic states concluded:

Overall, it can be concluded that the prevalence rate of generalized anxiety disorder and major depression in different European countries, including Denmark, Finland, Norway, and Sweden, are as high as those found in the United States. (‘Prevalence of generalized anxiety disorder in general practice in Denmark, Finland, Norway, and Sweden’, P. Munk-Jorgensen, Psychiatric Services, 57 (12), December 2006; p. 1738-44)

Similarly, a study of mental health in Norway compared rates of the most common mental disorders with those in the USA and found "almost identical rates for alcohol abuse, major depression, and social phobia in the two countries." (‘A Norwegian psychiatric epidemiological study’, E. Kringlen et al., American Journal of Psychiatry, 2001, 158; pp. 1091-98)

Incidentally, the largest systematic review of the prevalence of mental disorders in the EU (Wittchen & Jacobi, 2005 - summarised here (p. 47)), found the 12 month average to be 27%—ie. almost identical to estimates from the USA.


15. If equality creates good health, why does Denmark currently have the lowest life expectancy of any country in your list?

Wilkinson & Pickett: As with our other analyses, we (unlike our critics) do not pick and choose different countries to include or exclude according to whether or not their outcomes fit the inequality data. Denmark does indeed have much lower life expectancy than we would expect given its level of inequality. We have never claimed that income inequality is the only cause of worse health and social problems in a society. There will always be countries that do a bit better or worse on any outcome than we might predict given their level of inequality. Some researchers have attributed Denmark’s relatively poor health to its high levels of smoking.

Denmark doesn't have a particularly high level of smoking (see page 24 of SLD) and there is surprisingly little correlation between high smoking rates and low life expectancy when whole nations are compared. This only serves to highlight the problem of looking for the effect of one variable amongst aggregate data.

The simple fact is that the Scandinavian countries all have a very low level of inequality but vary wildly when it comes to life expectancy. Using data from the most recent UN HDR, out of 28 countries Sweden comes 8th, Norway comes 12th, Finland comes 19th and Denmark comes 27th.

Japan comes 1st, and this is the jewel in W & P's crown since Japan has an even lower level of inequality (by their measure, at least). But very unequal Hong Kong comes 2nd. Of course, readers of The Spirit Level will not know that because—although W & P "do not pick and choose different countries to include or exclude according to whether or not their outcomes fit the inequality data"—Hong Kong is never shown.


16. Why were Singapore and Hong Kong excluded from your graph on obesity?

Wilkinson & Pickett: The International Obesity Taskforce did not report data on obesity for Singapore in the 2002 report which was available when we were writing The Spirit Level. Hong Kong is not a nation state but even if it were it does not meet our inclusion criteria (see point 1).

The Singapore figure was published in 2004. The IOTF currently cites this figure so presumably we can expect it to appear in future editions of The Spirit Level.*

Hong Kong's somewhat unusual political status is no reason to exclude it. It is a country and both the World Bank and the United Nations treat it as such and collect data for it as a separate entity. It is certainly a separate and distinct society and The Spirit Level's subtitle is 'Why More Equal Societies Almost Always Do Better'. If US states fall under the category of separate societies, it is surely reasonable to include Hong Kong.

Why wouldn't Hong Kong meet the inclusion criteria? It has a population of over 7 million, it has sound data on inequality and came 16th in W & P's preferred list of rich countries.

* UPDATE 2011: The second edition is out and it is still missing.


17. Do you accept that the "correlation" between trust and equality rests entirely on figures from the four Nordic countries and that there is no pattern amongst the remaining 19 nations?

Wilkinson & Pickett: Absolutely not. These countries are NOT outliers, but lie on the trend line. However, even if they are excluded there is still a statistically significant correlation among the remaining countries (r=-0.46) as well as among US states where the correlation between trust and inequality is also highly significant (r=-0.7).

Again, this depends on which data are used. W & P's trust data come from the 1990s. If you use World Values Survey data from the 2000s, it is clear that the Scandinavian countries are outliers. The correlation disappears when they are excluded (see below). Even if you prefer W & P's older data set, their correlation is extremely weak.





18. Why do you say that young people "defer sexual activity" in more equal countries when there is no evidence for this?

Wilkinson & Pickett: We don’t say that people defer sexual activity in more equal countries – we simply discuss Professor Jay Belsky’s theory about quality versus quantity reproductive strategies which biologists have identified in many species.

W & P certainly do discuss Jay Belsky's theory that—as they put it—"people who grow up learning 'to perceive others as trustworthy, relationships as enduring and mutually rewarding and resources more or less constantly available' would mature later, defer sexual activity, be better at forming long-term relationships and invest more heavily in their children's development."

W & P precede this discussion by saying "there seem to be additional reasons why teenage motherhood is sensitive to degrees of inequality in society". They follow it by saying: "So there may be deep-seated adaptive processes which lead from more stressful and unequal societies." Apparently the reader should not infer from this that women in more equal societies defer sexual activity?!


19. If greater equality makes countries less violent and more law-abiding, why does Sweden have the highest rate of rape and theft of any country in your list? Why does Finland have the highest murder rate in Europe?

Wilkinson & Pickett: As we discuss in The Spirit Level, there are multiple influences on health and social problems, and income inequality is only one factor (albeit a strong and robust factor, demonstrated in more than 50 studies) affecting murder rates. Finland has a higher rate of homicides than we would predict, given its level of inequality, probably because of its high level of gun ownership. If we control for gun ownership in US states, the relationship between inequality and homicides actually gets stronger. For crimes other than homicides, comparing crime data among different countries is problematic, due to reporting differences. It seems sensible to assume that rape is more likely to be reported in societies where women’s status is higher.

It is not true that "more than 50 studies" have found a "strong and robust" association between inequality and homicide. Again, W & P mention a third variable (gun ownership) when they discuss Finland but do not give the same benefit of the doubt to Israel and the USA. In The Spirit Level, they do the same when trying to explain how the most equal state (Alaska) has one of the highest rates of homicide. They also make the questionable assumption that murders in America are carried out with legal firearms.

The assumption that Sweden has the highest rate of recorded rape because women are more likely to report sexual assaults is pure supposition.


20. Since when has the definition of a tax haven been a country with fewer than 3 million inhabitants? Isn't this just an excuse to leave out Slovenia?

Wilkinson & Pickett: The cut off for a small country has to be defined somehow – countries with populations around our 3 million cut-off point include Slovenia, Namibia, Lesotho, and Botswana. Slovenia is the only rich country with close to 3 million inhabitants excluded from our analyses. What happens if we add it in? Not much – the correlation between income inequality and homicides is r=0.42 (p=0.04) with Slovenia in, and r=0.43 (p=0.04) with Slovenia out. For imprisonment, the correlation with Slovenia in is r=0.66 (p<0.001), with Slovenia out, it is r=0.65 (p<0.001)….etc


No, the cut-off for a small country does not have to be defined somehow. A cut-off is completely unnecessary. All we need to know is which countries are tax havens (is Switzerland not a tax haven?). All the 3 million cut-off does is exclude Slovenia.

And, yes, including Slovenia often doesn't make a great deal of difference. That's isn't the point. We don't pick and choose the countries on the basis of whether they will make a difference. We include them so we have the full range of rich societies upon which to base our conclusions. Since The Spirit Level's conclusion is that "it falls to our generation to make one of the biggest transformations in human history" (p. 265), it would prudent to make sure the assumptions it is based on are not plucked out of the air.

It should also be noted that in one of their published studies, Wilkinson and Pickett "included only countries that had income inequality data and were among the richest 50 in the world and excluded those with populations of 50 in the world and excluded those with populations of less than two million to avoid possible tax havens." This allowed them to include Slovenia which, for the criterion studied in that paper, happened to strengthen the desired relationship. The switch from two million in this study to three million in The Spirit Level did not weed out any tax havens and served only to exclude Slovenia.


And finally...


A word about the scientific literature. W & P are fond of claiming that their work is backed up by 100s of peer-reviewed studies. In a recent letter to The Guardian, for example, they once again referred to "hundreds of other academic research papers which show similar patterns."

Do not be fooled. Very few of the studies referenced in The Spirit Level claim that health or social problems are caused by income inequality per se (as opposed to absolute income or other socio-economic factors). Of the few that do make such a case, many were written by Richard Wilkinson and/or Kate Pickett (they refer to no fewer than twelve of their own studies in The Spirit Level).

The bulk of the references are to newspaper articles, opinion pieces, other people's books, studies that discuss specific issues (eg. stress, violence, obesity) and the sources of the raw data (eg. UN, OECD). Often the studies referenced give equivocal support or contradict W & P (see Questions 4 & 7, for examples). The only area which has a significant body of scientific literature is health and inequality, and much of it disagrees with Wilkinson's hypothesis. As Wilkinson admitted in a recent interview with the magazine International Socialism, there is virtually no evidence from other academics to support the bulk of the claims made in The Spirit Level.

Wilkinson: "There are about 200 papers on health and inequality in lots of different settings, probably 40 or 50 looking at violence in relation to inequality, and very few looking at any of the other things in relation to inequality. In a way, the new work in the book is all these other variables—teenage births, mental illness, prison populations and so on—and the major contribution is bringing all of that into a picture that had previously been just health and violence."


These are, then, very much W & P's own ideas. Although The Spirit Level has launched their theories into the popular consciousness, they find little support in the scientific literature. It is no surprise, then, that their book has received a much cooler reception from academics (see below) than from ex-politicians and journalists.

"The bottom line is that this is a well-written, stimulating polemic. It nevertheless suffers from the same problems as one-trick ponies: if the one trick does not impress you, the show is a failure. Wilkinson and Pickett’s trick simply does not hold up to empirical scrutiny. When assessing this book as a contribution to the debate on the “right” level of income differences in modern society, it is a highly interesting, sympathetic attempt at addressing some of the important problems of Western societies. Yet, when assessing this book from a scientific point of view, one is forced to conclude that it is a failure."

— Christian Bjornskov, Professor of Economics, University of Aarhus, Population and Development Review, June 2010

"Wilkinson and Pickett have no time for nicely balanced judgements. They believe that the evidence they present shows beyond doubt that more equal societies ‘do better’, and they are also confident that they have the right explanation for why this is so... Their case is by no means so securely established as they try to make out... it has been called into question by other leading figures in the field – a fact that WP might have more fully acknowledged... WP’s inadequate, one-dimensional understanding of social stratification leads to major problems in their account of how the contextual effect is produced."

— John Goldthorpe, Emeritus Professor of Sociology, Nuffield College, Oxford; ‘Analysing social inequality’ European Sociological Review, 2009

"The evidence in The Spirit Level is weak, the analysis is superficial and the theory is unsupported."

— Peter Saunders, Emeritus Professor of Sociology, University of Sussex, Beware False Prophets

"The book will probably irritate most economists, including those like me who are sympathetic to its basic stance... source of irritation is the authors’ apparent belief that the application of regression methods to economic and social statistics is as novel to social science as it apparently is to medicine.  The evidence presented in the book is mostly a series of scatter diagrams with a regression line drawn through them.  If you remove the bold lines from the diagram, the pattern of points mostly looks random, and the data dominated by a few outliers... An obvious conclusion is that there are many societies which perform well in terms of their own criteria. America, Sweden and Japan are just different from each other. Their achievements are not really commensurable. But Wilkinson and Pickett are not content with this relativist position."

— John Kay, former Director of Institute of Fiscal Studies and Professor of Economics at London Business School, Financial Times, 2009



UPDATE

Sanandaji et al. have also written a detailed response to Wilkinson and Pickett's rebuttal of their criticisms. If you are interested in the debate about The Spirit Level (and, if you've got this far, you probably are!), I warmly recommend it. Click here.



24 comments:

Anonymous said...

I have no hesitation in recommending this book. The writing is excellent and the arguments are put very clearly. As the title says, Snowdon checks the facts: a tedious job, which almost never gets done - certainly not in such a competent and entertaining manner. He then brings to light relevant material which the authors of Spirit Level were either not aware of, or chose to ignore. That much of the book resembles a turkey shoot is a tribute to Snowdon's analytical talent and the huge amount of background research. The only section against which I thought an argument could possibly be made was "recycling". Critics might argue that more equal societies elect Governments which favour it.
I found this book far easier and more enjoyable to read than the Spirit Level. Don't be put off if you found that a bit of a chore. Since the Spirit Level became a favourite of the London Chattering Classes (lots of pictures and no hard sums), I don't anticipate much favourable attention from the broad sheets; although even the BBC recently managed to turn around its "5 a day" supertanker, so we can live in hope.
Should the Spirit Level Delusion impress you, why not order a copy of Snowdon's first book: Velvet Glove Iron Fist? You won't be disappointed.
Jonathan Bagley

Unknown said...

Thanks for this posting. I will now go and buy your book. I had read the Spirit Level and felt that it was very strange that all the data presented backed up the authors. It was as if this was the only area of scientific investigation that had no contrary data.

I am glad that you have the skills to address the unease that I felt when I read that book.

Henry Carlshamn said...

How surprising that someone working for a neoliberal organisation doesn't like the findings in The spirit level...

Christopher Snowdon said...

Henry,

I don't work for a neoliberal organisation. I don't now and never have. Not that it would matter if I had, but—as it happens—I haven't. Ad hominem arguments are always intellectually feeble, but are all the more so when aimed at the wrong target.

Perhaps it's not your fault. Wilkinson and Pickett have done a very good job of convincing their natural supporters that all the criticisms of their work are "politically motivated". That's nonsense too. Some people are just interested in testing hypotheses. To quote from a blog I was reading just yesterday (one which is far from 'neoliberal'):

"The points being made now by the critics of W & P are not new. While I'm sure we're not going to resolve this debate any time soon it would be grossly misleading to pretend that these criticisms are purely politically motivated. Many researchers in this field were unimpressed when Wilkinson first made these arguments and those objections still stand largely unanswered."

http://pyjamasinbananas.blogspot.com/2010/10/levelling-spirit-pt-1.html

ken nielsen said...

The link in the last para does not work.

Anonymous said...

Regarding the crime rate in the US, one of the leading causes of it being lower has to do with a substantial rise in inprisonment. See a couple of the charts on this Wikipedia article: http://en.wikipedia.org/wiki/Incarceration_in_the_United_States

Anonymous said...

Hong Kong isn't a country.

Christopher Snowdon said...

Anon,
Hong Kong has its own borders, own currency, own legal system, own parliament, own history, own identity and own passports. This makes it a country by any normal definition. HK's history is obviously unusual but it's an international city state and - this is the significant bit for the purpose of statistics - the UN collects data on Hong Kong separately. Ignoring that data because of the country's status of being a nation but not a full nation state is unjustifiable, which is why those who compare international statistics professionally don't do so - and why HK is on the sources used in TSL but was removed by W & P. It would be equally valid to study Scotland or Wales, neither of which are fully sovereign but both of which are - most people would agree - countries.

To digress slightly, The Spirit Level doesn't claim that the effects of inequality are confined to countries anyway. The claim is that it affects 'societies', including individual US states.

Matt S said...

Regarding question 17, on trust. You write that "If you use data from the 2000s"...

Which data/studies are you referring to?

Thanks.

Christopher Snowdon said...

Hi Matt,

The data are from the World Values Survey and can be accessed from www.worldvaluessurvey.org. This is the same source as used in The Spirit Level, but they use an older wave of the survey. I use the most recent data where available, ie. the 2005-08 series.

Vincent vd Lubbe said...

Thanks for some elucidating arguments. May I suggest some ideas which would help me understanding the discussion and make me more comfortable in checking both sides of the argument:

- Some of the arguments become clearly "ad hominem": accusations of dishonesty etc. Why do this? It doesn't help your argument, obscures it even more and goes "off topic" from a scientific discourse you are arguing to stimulate. Please refrain from doing this, it makes me doubt your professionalism.

- I would welcome if you and your opponents would hyperlink to the articles you cite, so it is possible to check. I applaud you making your citations transparent, that helps. You might even make screenshots or highlight these parts in the original texts, so they become more easily verifiable.

- I would welcome some arguments against your own points of view (I include your opponents). I mainly see arguments in favor of your respective point of view, which leads me to think this has become more of an ideological discourse than a scientific one focused on finding insights.

- It doesn't really help that the hyperlink you include with more discourse direct to a site (taxpayersalliance.com) which has a clearly politically motivated stance on government. Even if I would have not known your arguments (how valid they may be), I might already have guessed how they might be directed solely from the forum they are being discussed. If you want to make it more focused on content, please direct your readers to peer reviewed articles published as a review of W&L's book and/or articles. You already did that to some extent, thanks for that.

Christopher Snowdon said...

Vincent,

Thanks for your comments. There are more hyperlinks to put in and your comment has prompted me to get round to doing so.

I've put a list of articles on the right hand side of the blog in a timeline that gives various different points of view. I make the assumption that anyone who is sufficiently interested to read this post has already read The Spirit Level, which is of course the argument I am challenging. This particular post includes W & P's responses in full.

The TPA article is, I think, the only English language response from Sanandaji et al, who produced their own independent critique of The Spirit Level. The TPA have their own political viewpoint, just as the Equality Trust does, but that doesn't negate what Sanandaji has to say.

Not sure which are the ad hominems. Please give examples. Thanks.

indiscreetpete said...

In question 5 you mention that removing Portugal drops the r-squared from 0.1 to 0.89. Should that read 0.089, or am I misunderstanding the statistics?

Christopher Snowdon said...

That is indeed a typo. Thanks for spotting it. Now corrected.

Gerald said...

"Some people are just interested in testing hypotheses." If this is true, your case would have been better served by omitting any reference to "The Left" in the title of your book.

Christopher Snowdon said...

Gerald,
Tempted to agree with you. A few Marxist friends and even a Labour politician have told me that The Spirit Level in no way represents their views. 'Misanthropic, middle-class champagne socialists' would have been a better term to use.

Anonymous said...

I'm sorry but how can you mention the problem of ad hominem attacks and then, with a straight face, use such expressions as "Misanthropic, middle-class champagne socialists" to describe people who simply believe that greater equality is healthy for societies. Being centrist myself, I just can't help but notice W & P have not shown once such a lack of professionalism toward their critics.

Christopher Snowdon said...

Anon,

Using a pejorative term is not the same thing as making an ad hom argument, and I challenge your assumption all blog comments are made with a straight face. In any case, it refers to the people for whom TSL is a theory of everything - not necessarily the authors, who I would not immediately associate with champagne - and it is not because they believe that 'equality is healthy' but because they are keen on zero growth that they are misanthropic. And I'd rather be called a misanthrope than a member of the far-right, which is what W & P, in their 'professionalism', have called their critics (amongst many other pejoratives).

ab0032 said...

Thank you for this great work. Just for the fun of it I created a plot freedom vs inequality, with the countries from the TED video, but dont take it too seriously.
Interestingly Greece, Italy, France, Portugal stick out the bottom, which does not surprise me at all, as the EU and the Euro as well as socialist politics are destroying them.
http://www.facebook.com/photo.php?fbid=10151560493408665&set=pb.721993664.-2207520000.1363992773&type=3&theater

Christopher Snowdon said...

Thanks. I should clarify for anyone who stumbles on this post that the Heritage measure is of economic freedom rather than freedom generally. I doubt Singapore would score so highly on a measure of social liberty.

The new Human Development Report has recently been published. If I get some time I'll update some of the graphs with the latest data from that.

Anonymous said...

I like how they point to Finland's homicide rate being higher than other "equal" countries, despite the fact that only 14% of overall homicides in Finland involve guns.

http://news.bbc.co.uk/2/hi/europe/7087494.stm

Unknown said...

Great job of distorting research results. One example is citing a study in Canada's healthcare system that found that differences in health correlated with absolute wealth. Wilkinson et. al. would not find that surprising. They never suggested at wealth within a country or a US state was not a major factor in individual health. However, they did find strong correlation between the relative amount of inequality between nations or states with health outcomes for all citizens including those were were wealthier. No better evidence of the benefits of a more equal society to health than the analysis found in 'The American Health Care Paradox'. Give it a read if you like research based information more than ideology.

Christopher Snowdon said...

Unknown,

I've no idea which study you're referring to, but if it's in the post above it will have something to do with inequality.

Yes, health correlates with wealth at the individual level, there's no doubt about it. Wilkinson does, however, say that "wealth within a country" is not an important factor in the countries studied in The Spirit Level. In fact, he pretty much starts the book with that argument (see p. 6-7 and p. 12). It's integral to what follows. If that's your killer example of me 'distorting research results', I can see why you didn't provide any more.

I'm well aware the W & P have claimed that there is a correlation between inequality and health, thanks. I've written extensively about that so won't go into it again here.

I'm not in the habit of buying books on the recommendation of mildly abusive anonymous commentators, but I'm sure the author will be pleased by the plug.

David Nutsford said...

Hi Chris,

Well done finding these gaps in the research, these 'leaps of statistical analysis' for us.
I have only read the first and last chapters of TSL because I know that trawling through all the stats is going to be a pointless exercise.

The thing with inequality (both within countries and between them) is that its very hard to measure. Sure, we can know who earns what and how much of the wealth is held by how many people but after that it gets very tricky.

How much 'equality weighting' do you give to tax rate? What is the tax spent on? How big is the black market? How much do they value money as a society? How many hours are people working to gain their income (this affects both rich and poor people)?

Similar issues arise with crime, mental illness and happiness. How do you measure these things? How much goes unreported? How much do you weight for laws and cultural norms?

W & P try to show that inequality has a consistent negative effect on various social outcomes - it does not have to be the biggest effect. When you take individual countries and say 'hang on, look at Finland's murder rate, it doesn't fit the trend' then you are missing the point. For whatever reason Finland has lots of murders - as you have said yourself, there are other factors at play here.

You do seem to take an unbiased 'this doesn't prove anything either way' approach to the effects of inequality; however, I can see you feel strongly about W & P's promotion of a zero-growth economy. Is this where your distrust of TSL comes from?
Could you tell me a bit about why you are against a zero-growth economy?
Thanks