How to tell an expert from an "expert" Posted by Ilan Goldenberg

Matt and Gideon Rose are having a pretty interesting exchange regarding expertise and the Democratic foreign policy community.  I completely agree with Matt when he writes

I don't think anyone in the blogosphere is, against expertise and professionalism. The question is whether some of our country's self-proclaimed experts -- and media proclaimed experts -- really deserve to be considered experts. What, for example, is the nature of Michael O'Hanlon's expertise on the broad range of subjects (his official bio lists him as an expert on "Arms treaties; Asian security issues; Homeland security; Iraq policy; Military technology; Missile defense; North Korea policy; Peacekeeping operations; Taiwan policy, military analysis; U.S. defense strategy and budget")

It's not that the entire VSP community is bad.  The question is how do you tell the difference between a hack and someone who is a genuine expert?  This actually isn't too hard to figure out.  First, regional experts generally tend to be more well informed than functional experts because of their narrower focus. There is a long list of foreign policy experts who specialize in the Middle East (And did so before 9/11 came around). Jon Alterman, Brian Katulis, Mark Lynch, Ray Takeyh, Steven Simon, Flynt Levrett, Vali Nasr, Steven Cook, Rob Malley to name just a few.  Most of these people speak Arabic or Farsi.  Most have spent sigificant time in the region or spent a great deal of time studying the history of the region and the intimate details.  They know much more than you, me, Matt Yglesias or Gideon Rose do about the Middle East.  Not surprisingly a large majority of these regional experts were opposed to the Iraq War.  The problem is no one listened.  The issue became so main stream that many functional experts who knew very little about the region stepped in and start calling themselves Middle East experts and make assertions as "experts" on what the U.S. should be doing.  During the Cold War everyone was a Soviet "expert."  Today everyone is a Middle East "expert".  (Ken Pollack is the clear exception to the rule.  He has rigorously studied the Middle East, but was just flat out wrong about Iraq).

Another of indicator of expertise is the think tank bio page.  As Matt hints at, there is an inverse correlation between the number of areas of expertise listed in your bio and your actual expertise.  What also matters is whether the listing of expertise makes any sense and whether the various areas are related.  For example, Tony Cordesman, who quite frankly knows more than you, me, or just about anybody else about the Middle East, only lists four areas of expertise on his bio:  Energy, Middle East & North Africa, Defense Policy, and Terrorism.  This makes absolute sense he is a Middle East miliary analyst and has been for more than 30 years.  You really can't study that region without also learning about oil and terrorism.  O'hanlon on the other hand has a much longer list that makes no sense.  How can someone who is a Tawain policy expert (People dedicate their entire careers to studying the cross straits issue) also be an expert on homeland security, also be an expert on Iraq, also be an expert on North Korea.  Either he is just smarter than all of us, or more likely there is much less rigor.

None of these rules are hard and fast.  There are some really smart, knowledgeable functional experts and some very irresponsible regional experts.  Some people really are genuine experts in a lot of stuff (They usually have gray hair). But generally speaking a careful look through the bio can quickly distinguish an expert from an "expert." 

Comments

[darrelplant]

You missed what should be the most important gauge: "track record".

Someone can have read all of the books, speak all of the languages, done all of the travel, and spoken to all of the cabdrivers in all of the cities around the world that they want, but if they have poor judgment and they keep making bad predictions, and the guy with the English degree and a computer and a blog can judge the situation better than they can, then they may be an "expert" but they're not an "accurate" expert.

[Don Bacon]

Anybody who's done a few things can write a colorful biography--written a few myself. But the bio doesn't tell you, as darrelplant points out, what the person has actually accomplished, or how smart they are, or, in the case of Mr. Cordesman, how independent and open-minded they are. These are traits that can't be seen in a bio, no matter how short or long it is. It goes back to the track record that dp mentioned--a person's reputation. An illustration:
-----------------
excerpt from the Tracy Press
http://tracypress.com/content/view/10724/2244/

We were impressed with the commentary of two so-called war critics in The New York Times on July 31. The headline over Michael O’Hanlon’s and Kenneth Pollack’s op-ed proclaimed patriotically: “A War We Just Might Win.”

The conclusion of the American visitors to Iraq: “We were surprised by the gains we saw and the potential to produce not necessarily ‘victory’ but a sustainable stability that both the U.S. and the Iraqis could live with.”

If a senior fellow and a director of research at the Brookings Institution, a nonprofit think-tank, can conclude from frontline observations and interviews with Americans and Iraqis that the surge in Baghdad and Anbar province is working, it must be true.

However, we started to doubt O’Hanlon and Pollack’s assertion when the third member of their study group, Anthony Cordesman, from the Center for Strategic and International Studies, published a vastly different assessment. He declared in a “trip report” that “Iraq is a gamble,” and that it was lucky timing and the hatred of Sunni tribes of a common enemy — al-Qaida — that compensated for a “failed surge strategy.”

We thought it was just a difference of opinion among scholars, until we discovered the logistics of this July 7½-day “trip” to Iraq.

It was arranged and planned by the Department of Defense, from the air flight, to the living accommodations in Baghdad’s Green Zone, to the Americans and Iraqis interviewed. With military security in tow, O’Hanlon and Pollack ventured out of the fortified Green Zone up to just four hours a day, never leaving their secure area after dark.

They admit they never got an objective view of the surge from an Iraqi perspective. Yet, they give the impression, in a travel-log style, that Iraq has turned the corner on national security.

Cordesman didn’t simply take the word of these Pentagon puppets. He researched intelligence data and government watchdog reports, comparing what the selected interviewees said to the written summaries. He questioned the unchosen ones on the streets.

Unlike O’Hanlon and Pollock, Cordesman observed all sides.

[steve EVfuture]

For starters, how about ignoring privately funded "think tanks" altogether? They are nothing more than propaganda outlets for a particular agenda. Only consult academics in the field, preferably with a doctorate in something that resembles the area of interest. You don't go to a "doctor" when you are sick, you go to a guy who received an M.D. from an accredited medical school and you don't go to proctologist if you are getting open heart surgery.

[Philippe Duhart]

The overstating of one's expertise is something grad students with little in the way of actual interests and a limited knowledge base tend to do. They naively believe drawing on every academic fad males them more marketable, rather than demonstrated that they are unfocused pseudo-scholars.

The sad thing is that this ploy has worked for O'Hanlon and his ilk.

By the way, Pollack is considered an expert on Iran, despite his inability to speak Farsi, the fact that he's never set foot in Iran, and that his book on the subject does not sight a single non-Western source.

So much for "expertise."

[Doctor Biobrain]

I think the key to being an "expert" is that you agree with what all the other "experts" say and you are able to articulate these opinions in an intelligent sounding way which would appear as if you're adding something new to the discussion, rather than just regurgitating what you learned from the others. But if the establishment doesn't want to hear what you've got to say, then you just won't be heard. Few "experts" fall into this category. They speak, not to be right, but to be heard.

[dave™©]

I gotta say, this site has the stupidest, most clueless writing this side of Althouse.

And that's saying a lot...

[SolderNoLongerInIraq]

I've always wondered how our self-proclaimed "military expert" managed to get his start in that rather important field as "an investment banker at Salomon Smith Barney."

Seeing as I speak Arabic and Hebrew (well, up until the bar mitzvah, anyway), have served two tours in the region (three in my lifetime counting Desert Storm), and also opposed the invasion, why don't I count myself as an "expert?"

Sure, sure. There's the post-graduate schooling, and the deep immersion in Iraqi culture, not to mention the direct experience of combat.

But I think it boils down to "hubris." Anthony Cordesman wouldn't assume that he speaks profoundly of combat or power projection or Iraq.

Why do so many "experts" here?

[mcb]

Soldier Not in Iraq, did you not get a job a Solomon Smith Barney or something?

I checked Goldenberg's bio: he's never referred to himself as any type of expert, let alone a military expert.

It is fair enough to criticize his ideas, just don't get personal. Or at least get it right when you make it personal.

[flounder]

Here is how I tell an expert from an "expert". If you were wrong once, then spent the next four years that you weren't wrong, because everything is going to turn around six months from now, you are not an expert at anything except job security. I dare you to try screwing up for four years straight at my job or any other except editor of the National Review.

[Uncle Smokes]

The word "expert" comes from "experience" which ultimately comes from the Latin for "out of peril."

I suppose one could ask what test of peril a proclaimed expert has faced to gain insight.

If it is the peril of being out of a job for straying from the frames and filters, the pale of acceptable discourse within the chosen tanks of group-think, then I'm not terribly impressed.

There is no subsitute for thinking for one's self. Take indoctrinated pronouncements of disciplined pecking orders with all the salt in the Dead Sea.

[christian h.]

This is what's wrong with the liberal foreign policy position: the need for expertise. Because mainstream liberal foreign policy thought takes it as a given that there are situations in which the US has the right, or even duty, to engage in wars of aggression, we then need experts to tell us when to do so.
As a radical, I didn't need an expert to tell me that the US and allies had absolutely no right to attack Iraq. I don't need experts to convince me that we have no right to attack Iran. Or Sudan. Or anybody else, for that matter. Kind of the same way I don't need to be an expert on, say, education, to know that shooting up a highschool is wrong. Expertise, my ass. What's needed is some basic commitment to justice.

[SolderNoLongerInIraq]

I don't know, MCB. He certainly hasn't eluded the title when it has been offered at: Voila, his National Security Network (one of "Our Experts" in their boilerplate), a forum that's termed by WAPO and USA Today "an organization of security experts" (probably from the press release).

So he and his organization have arrogated unto themselves the mantle of "expert" on the issue of "national security."

Now, I have the distinction of being at the tip of this nation's security spear, so to speak, having swapped much of my adult life as an armed indentured servant of our foreign policy.

I don't consider a term at a brokerage house, some courses in Arabic and a desk at NSN to be any more indicative of expertise than anything two scholars at Brookings could cook up.

He's calling them out on their "expertise." But he blogs constantly about things that, frankly, strike practitioners in the very field he considers within his "expertise" to be, well, insane.

Perhaps more than insane. Amongst a generation of military men, we've come to strongly question the prudent, assured expertise of those who claim to be "national security" gurus, and yet have never thought of wearing the uniform.

Some of us have been marched into combat by Republicans (Panama, Desert Storm, Somalia, OIF/OEF) and Democrats (Somalia, the Balkans), so it's hardly a partisan disdain.

Why, "expert" hacks of both parties deserve our disdain.

Now, I'm more than willing to concede that Phillip Carter is something of an expert on Iraq and terrorism, considering that he deployed to Iraq, spent much of his adult years in uniform, and writes often about national security issues pertaining to same.

I'll concede that Rand Beers knows a thing or two about terrorists (perhaps not so much about Iraq), too.

But when I look up and down the "Area of Expertise: Iraq" display on the NSN website, I don't see many old hands to whom I'd entrust regional policy concerns.

In fact, like those over at Brookings for whom he has little regard, our resident "expert" on things military shares office space with "experts" seemingly conversant (or, self-described as such) with Russia, Energy Policy, Iraq, Afghanistan and (fill in the blanks).

In other words, they seem to use the same forms as Brookings.

He makes this a personal jihad against two fellows there, well, good for him. He might never be an Addison or a Steele, but at least he's got pluck!

He probably thought no one would read his own biography (nope, no "expert" on "experts," no working knowledge of what combat is like), or those of his colleagues (so many "experts" on so many things!) at a rival thinktank, or whatever it is.

Good for the goose is good for the Goldenberg, I say.

Based on what I've

[Enoch Root]

Quoth: "(Ken Pollack is the clear exception to the rule. He has rigorously studied the Middle East, but was just flat out wrong about Iraq)."

Statements like this, my friends, are why we laugh at the 'foreign policy community.' Here, let me restate: "Parenthetically, I'd like to point out that these rules don't actually mean anything at all, because Ken Pollack, who has garnered at least four book deals by being a career-minded CIA spook with a resume, was completely flippin' wrong about everything for the last six years, which I'm at a loss to explain, but which doesn't really matter because if it did, he'd have at least some of the blood of maybe six hundred fifty thousand Iraqis and thirty-five hundred US soldiers on his hand. Clearly the exception to the rule, however."

[Enoch Root]

I mean, really. Forgive me for being bitter, but while you 'liberal' hawks are trying to figure out how to avoid responsibility, people are dying because of your mistakes. And that's just the plain truth.

[dirk gently]

i would propose that people who have been consistently wrong for six or more years not be considered experts.

and vice versa.

[wobbly]

And what about the moral dimension?

All these experts are basically talking about killing lots of human beings.

I don't have a dog in this fight. My boys are safely in college, far, far, away from the National Guard, or any other entity that might conceivably have to play out these conflicting scenarios...

Ooops, they do live in New York, New York.

They ride the subways. They co-exist with very happy memories of the World Trade Center, where their father worked when we were married...

And the the stink and horror of what they saw on their post 9/11 visits to their father after the divorce...

I don't think 9/11 "changed everything".

But it should have changed something...like this mindset that doing a cost-benefit analysis, doing this Cordesman vs O'Hanlon argument...

...amounts to a hill of beans.

Human beings are killing human beings. Lots of educated folks are thinking and writing about how this is ok, at least in Iraq, for the time being...

Other educated folks argue that this was wrong from the get-go..

Hey, do you need to know Farsi to know which way the wind blows???

I want my boys to survive. I've worked very hard to educate them, I've been out there demonstrating against every American war since 1968...

Isn't it true that either one or both of my sons could die tomorrow?

Some jerk Muslim taxi driver, infuriated about his wife's transgressions OR the IRAQ WAR, could actually throw a can of gasoline
into a subway car and a match after it...

And kill both my boys?

Or just one?

Doesn't that situation suck?

Somehow or other, my perfect country chose to kill insignificant people in other places...for their own good, of course...

The insignificant struck back 9/11.

I see lots of people taking advantage of this...yeah, Republicans,
mostly...

Seriously, nobody has made NY/NY any safer or more secure since 9/11.

Rivers of blood have been shed, mostly Iraqi blood...and the jerks on this site and many others blog on about... what?

[wobbly]

And what about the moral dimension?

All these experts are basically talking about killing lots of human beings.

I don't have a dog in this fight. My boys are safely in college, far, far, away from the National Guard, or any other entity that might conceivably have to play out these conflicting scenarios...

Ooops, they do live in New York, New York.

They ride the subways. They co-exist with very happy memories of the World Trade Center, where their father worked when we were married...

And the the stink and horror of what they saw on their post 9/11 visits to their father after the divorce...

I don't think 9/11 "changed everything".

But it should have changed something...like this mindset that doing a cost-benefit analysis, doing this Cordesman vs O'Hanlon argument...

...amounts to a hill of beans.

Human beings are killing human beings. Lots of educated folks are thinking and writing about how this is ok, at least in Iraq, for the time being...

Other educated folks argue that this was wrong from the get-go..

Hey, do you need to know Farsi to know which way the wind blows???

I want my boys to survive. I've worked very hard to educate them, I've been out there demonstrating against every American war since 1968...

Isn't it true that either one or both of my sons could die tomorrow?

Some jerk Muslim taxi driver, infuriated about his wife's transgressions OR the IRAQ WAR, could actually throw a can of gasoline
into a subway car and a match after it...

And kill both my boys?

Or just one?

Doesn't that situation suck?

Somehow or other, my perfect country chose to kill insignificant people in other places...for their own good, of course...

The insignificant struck back 9/11.

I see lots of people taking advantage of this...yeah, Republicans,
mostly...

Seriously, nobody has made NY/NY any safer or more secure since 9/11.

Rivers of blood have been shed, mostly Iraqi blood...and the jerks on this site and many others blog on about... what?

[Uncle Smokes]

"If the Confederacy falls, there should be written on its tombstone: DIED OF A THEORY."
-- Jefferson Davis

When the Republic fails, there should be scratched upon it's pauper's pine box: SMOTHERED BY POLICY.

[masaccio]

I am an expert in my profession. I say this because I have more than 30 years of experience, a known track record, and a steady flow of clients referred to me by my colleagues. People pay me because I am right a lot. I would starve if I started failing. How does your description of national security expertise comport with my claim?

[Don Bacon]

Experts with an agenda can't be trusted. According to a recent CNN poll, 53 percent of Americans said they suspect that the military assessment of the Iraq situation will try to make it sound better than it actually is.

[darrelplant]

George W. Bush is a pretty good example of someone who fits into the conventional "expert" category. Yale undergrad. Harvard MBA. Officer at a variety of oil compaanies. Partner in a successful baseball franchise. Scion of political dynasties stretching back to the mid-nineteenth century on both sides of his family. Related to European royalty (but not too closely). Involved on the campaigns of his father, a former president of the United States. Yet nonetheless a man of the people with a ranch in Texas.

At least, that's how it was painted back when he ran for governor of Texas and then president.

Sounds pretty appealing, doesn't it? Unless you actually knew about the details between the bullet points.

[Lupin]

The King of Poland, I think, used to finance expert alchemists who promised him the secret of turning base metals into gold.

I, for one, am glad we have made much progress since these benighted times.

Seriously, the ability to analyze and predict accurately ought to be the cardinal issue. After, say, three years, no one without a solid track record (or a working philosopher's stone) ought to be entitled to call himself an "expert."

I also think that, like the King of Poland, we ought to decapitate or hang those so-called "experts" who took advantage of our generosity.

[IM]

Ah, but Augustus the strong, elector of Saxony and king of Poland, was "a hero in error", don't you know. His alchemist didn't discover gold, but he did discover porcelaine.
All is well thats ends well, just ask Mr. Chalabi.

[Stuart Eugene Thiel]

I don't thin' the word [expert] means what you thin' it means.

A corporate consultant like McKinsey listens carefully to what the client says (and doesn't quite say) and provides theoretical cover for the distasteful thing the client wants to do, e.g. "lay off all the factory workers and move production to Mexico."

An expert witness, in court, is a person with credentials and reputation who's willing (for a suitable fee) to swear to what the client wants to hear.

Another word for this sort of "expert" is "whore." This definition covers the foreign-policy experts sought by the MSM and other deep-pocketed corporations. It also helps to account why people like O'Hanlon suffer no cognitive dissonance when they switch positions and insist that black isn't white after all, black is actually black. They're being perfectly consistent with the axiom that the paying client is always right.

[SteveB]

Enoch Root nailed it, but I don't think Enoch goes far enough. Ken Pollack isn't just the exception to the rule, he's the exception that proves the rule, meaning that the rule is all the more strong because we've been lucky enough to find an exception to it.

And if that doesn't make any sense to you, then you're not an "expert".