Empiricism, Normativity, and the Burdens of Judgment
Here’s another little point I want to make about the idea of empiricism in politics and social science. The “empirical” results in the social sciences are often not gained through direct observation, but through often quite loose measurement techniques involving all sorts of proxies and approximations. So, when I hear somebody say “Real wages have declined since 1970″ or something like that, and I snort with absolute incredulity, and they point me to some BLS chart, and I demand to know how we calculate real wages, and then I’m told about the CPI, and I assert that the methodology of the CPI must be flawed because it is obvious by casual observation that real wages have increased a great deal, who’s the empiricist? Were economic liberals being good empiricists when they bitched about the Boskin report?
Alex Tabarrok (like his co-blogger, also at least as good an economist as Michael Kinsley) makes this sort of measurement method contesting move this morning on the WSJ Econoblog:
Is America on a consumption binge? In 2003 the savings rate was a paltry 1.2% — the lowest rate since the Great Depression, when savings briefly went negative. But before we tighten our belts we need to know that the standard measure of personal savings (from the National Income and Product Accounts) is highly flawed.[empasis added]
Savings in the NIPA are defined as income minus consumption. But what is consumption? The NIPA defines education expenditures as consumption, but try as I might to keep my students’ attention with the occasional joke, I think few would report that they are paying me for entertainment value alone. Education expenditures ought to be defined as investment financed from savings.
The NIPA also measures savings on an annual basis. But suppose that you are asked what your savings are. You probably don’t add up this year’s income and subtract this year’s consumption, instead you add up your stock of savings; the value of all of your assets including equities, bonds, net housing value, cash and so forth. The latter measure is the right one if we want to measure provision for the future.
The flow and stock measures of savings can easily move in different directions. Indeed, a major reason that the yearly savings rate has declined is precisely because the value of assets has increased.
A declining savings rate, therefore, can easily signal positive things about people’s net asset position. Similarly, we have in recent years experienced a boom in productivity. If individuals expect the boom to continue, it may be quite rational to reduce current savings.
If I insist that the CPI is screwy, or Alex insists that NIPA is screwy, it’s probably because we think it fails to adequately measure observed economic phenomena, or fails to take into account what our best theory says a measurement device ought to be taking into account. Imagine that the motivation for our complaints about measurement comes from our ideological commitments. So be it. Empricism care not about our motivation, as long as we are doing our best to save the phenomena.
My broader point is that the social sciences have a normative upshot. We care about how we measure and reason about the social world because we want to make the social world better. Our normative commitments will inevitably guide the way we generate hypotheses and affect our choice of methodological tools for testing those hypotheses. But this is not counter to empiricism. These are the mechanisms through which empiricism in the social sciences operate. Chait’s hackish claims of virtuous wertfreiheit empiricism betray a kind of self-satisfied naivete that actually threatens the kind of epistemic virtue necessary for empiricsm in social sciencces by encouraging a lack of reflection about the scientific producer’s and consumer’s necessary engagement with and commitment to norms in the social domain.
The empirical, descriptive task in the social sciences is not separable from the normative task. I believe that empirical investigation in the social sciences ought to be as neutral among values as possible. But the question of what constitutes a neutral investigative stance is not itself a question of social science, is essentially contestable, and the argument for wertfreiheit is itself a contestable normative argument. Science in general works because scientific practices and scientific communities embody certain norms and epistemic virtues. Science does not proceed through the application of a Baconian algorithm. Social science studies human action and human coordination, phenomena that cannot even be adequately described without mentioning the normative, goal-seeking nature of practical reasoning or normative features of coordination. (The idea of a market failure, for example, which Chait makes use of, is a normative notion about coordination.) And it seems neither plausible nor desirable for the social scientific community to to pretend indifference to the norm-ladeness of their domain.
Just how and to what extent the social scientist should engage with or be guided by normative conceptions in the conduct of empirical inquiry are very hard questions. Discuss at will.




February 23rd, 2005 15:57
What a crazy coincidence.
I am enjoying the new (well, it was new when I started) Caldwell book on Hayek, and you sound precisely like a young Max Weber.
Ah positivism! We hardly knew ye.
February 23rd, 2005 16:06
There are worse people to sound like!
February 23rd, 2005 19:56
Will:
Are you just saying that social scientists are influenced by their normative beliefs (in which case, even a paid-up positivist agrees with you, but likes to think that the process of scientific dispute will weed these biases out)?
Or are you saying that there is something about the human sciences which bridges the is-ought gap?
February 24th, 2005 06:40
Hard sciences have certain constants, like the speed of light, that allows them to advance beyond the ‘what does this mean’ stage of inquiry and actually make predictions. The value of hard sciences rests almost entirely in this ability to predict.
Social sciences, on the other hand, seem to be stuck in an endless descriptive phase. Yeah, assets have risen in value, but the dollar has fallen in value, so those assets have actually decreased in value relative to the foreigners who supply a lot of our goods, etc, etc. etc….blah blah.
Everybody has a different opinion about what is good or bad, worthless or valuable, etc. ‘Empirical’ research in the social sciences is impossible, IMHO
March 1st, 2005 07:55
‘My broader point is that the social sciences have a normative upshot. We care about how we measure and reason about the social world because we want to make the social world better. ‘
Surely this is true for science in general. We study economics because we want to learn how best to manipulate policy to acheive the desired results. We study physics because we want to learn how best to manipulate the rules we discover to acheive the desired results.
Also, to monkyboy. The difference between predictability in the hard and the social science is by degree. It’s all down to how far individual variables can be isolated and tested. This being true advances in neuroscience may well be the key to narrowing the gap.
March 1st, 2005 19:08
Kinda quiet around here lately…
Bernard,
I don’t see how the social sciences can help the current debate about Social Security reform.
If we could implement private accounts, see how it worked out fifty years later, then rewind the clock and see how the current program worked untouched, that would be science. Well, if we could try each way hundreds of times just to be sure, it would be science.