Military Times Damages Credibility by Promoting Unscientific "Survey"

by: Brandon Friedman

Wed Dec 31, 2008 at 02:09:22 AM EST


Once again, the widely-read Military Times is deliberately attempting to accentuate the perceived rift between the military and the incoming Obama administration by promoting an amateurish, unscientific survey called the "2008 Military Times Poll."  Here's the headline for the main article:

2008 Military Times poll: Wary about Obama

Troops cite inexperience, Iraq timetable

Using the same data, they also have an accompanying piece with a similarly divisive lead:

Troops oppose repeal of 'don't ask'

Of course, both articles are full of self-selected, academically useless responses from the Military Times' older, white, subscribing readership.  The only question is whether they're doing this deliberately, or whether no one who works at the paper is actually educated enough to know how important the difference is between a scientific survey and a haphazardly conducted poll of subscribers who choose to participate.  

Either way, they've completely blown up the idea of journalistic credibility by actively pushing this nonsense.  And this is critically important because the Military Times has long been the most respected source of objective information for uniformed service members.  

Let's start with the main piece.  It begins this way:

When asked how they feel about President-elect Barack Obama as commander in chief, six out of 10 active-duty service members say they are uncertain or pessimistic, according to a Military Times survey.

This is dishonesty right off the bat.  By saying "six out of 10 active-duty service members," the Times is implying that they've randomly selected active duty members of the military for the survey--and that their sample is representative of the entire military.  They're implying this because that's how professional, credible polling companies conduct surveys.  Unfortunately, the Military Times is either too cheap or too daft to do a poll the right way.  So naturally, I looked for an explanation.  At the very bottom of the page, I found a link with the fine print:

Although public opinion pollsters use random selection to survey the general public, the Military Times survey is based on responses from those who chose to participate. That means it is impossible to calculate statistical margins of error commonly reported in opinion surveys, because those calculations depend on random sampling techniques.

The voluntary nature of the survey, the dependence on e-mail and the characteristics of Military Times readers could affect the results.

No.  Sorry guys.  It couldn't just "affect the results."  It actually invalidates the entire survey as anything resembling a realistic reflection of attitudes within the military.  

Nevertheless, the Times spends the next 11 paragraphs highlighting the dissension and distrust within the ranks toward Obama--through commentary like this:

"Being that the Marine Corps can be sent anywhere in the world with the snap of his fingers, nobody has confidence in this guy as commander in chief," said one lance corporal who asked not to be identified.

For eight years, members of the U.S. military have served under a Republican commander in chief who reflected their generally conservative views and led them to war in Afghanistan and Iraq.

Now, the troops face change not only at the very top of the chain of command, as Obama nears his Jan. 20 inauguration, but perhaps in mission, policy and values.

Underlying much of the uncertainty is Obama's stated 16-month timetable for pulling combat troops out of Iraq, as well as his calls to end the "don't ask, don't tell" policy to allow gays to serve openly in the military, according to survey responses and interviews.

"How are you going to safely pull combat troops out of Iraq?" said Air Force 1st Lt. Rachel Kleinpeter, an intelligence officer with the 100th Operations Support Squadron at RAF Mildenhall, England. "And if you're pulling out combat troops, who are you leaving to help support what's left? What happens if Iraq falls back into chaos? Are we going to be there in five years doing the same thing over again?"

Oddly enough, after spending nearly half the piece suggesting that the survey is representative of the military as a whole, the Times quietly slips in these two sentences:

The responses are not representative of the opinions of the military as a whole. The survey group overall under-represents minorities, women and junior enlisted service members, and over-represents soldiers.

So they're basically saying, "Pay no attention to our divisive headlines or, in fact, most of our article.  Just accept our conclusions as we've framed them, even though we're now telling you that we knowingly under-represented Obama's primary constituency, and that we have no scientific basis for what we're presenting as 'facts.'"

But it doesn't get any better.  The second piece using the "data" is just as shoddy in its analysis of troop attitudes toward the Don't Ask, Don't Tell policy.  First paragraph:

Most active-duty service members continue to oppose President-elect Barack Obama's campaign pledge to end the "don't ask, don't tell" policy to allow gays to serve openly in the military, a Military Times survey shows.

Again, this is total dishonesty.  By saying "most active-duty service members," the Military Times is insulting each individual who's ever worked hard to earn a graduate degree in the field of social sciences.  They've provided no empirical evidence to corroborate such a statement.  Maybe it's true, maybe it's not.  But we have no way of knowing based on the ridiculous data they've provided.

To their credit, in this second piece, the Times does interview two supporters of the DADT policy and two who oppose it.  However, the "expert" chosen by the paper to represent the anti-gay viewpoint is none other than Elaine Donnelly, to whom they allocate a full 20 percent of the article.  For those who are unfamiliar, Elaine Donnelly is the unbalanced, homophobic, nutjob who reporters and Congressional committees trot out whenever they need a useful bigot to represent the minority of Americans who disapprove of homosexuality.  Donnelly doesn't even have any connection with the military other than her vociferous opposition to gays serving in it.  She never served in uniform and she has no discernible academic background on the topic (as the other expert for the piece does).  As far as I can tell, she attended community college in Livonia, Michigan and then earned some undergrad credits at the University of Detroit.  Which makes her as much of an expert on the matter as your average policy analyst from the local Klavern down on County Road 126.

Elaine Donnelly, the founder and president of the Center for Military Readiness, which supports the ban, said the number of discharges under "don't ask, don't tell" could be reduced to near zero if induction forms contained a question about sexual preference.
. . .
Donnelly warned of the consequences in repealing the ban, which she said could include forced cohabitation of heterosexuals and homosexuals in all branches of the military and disciplinary action against those who oppose or protest the integration.

So on top of faulty data, the Times is resorting to the use of a simple extremist to provide perspective on the debate.

The overarching problem with these pieces is that the Military Times has sacrificed journalistic integrity in order to portray itself as the final word--as the authority--on the views of America's troops.  In reality, however, they were too lazy or too cheap to conduct a real survey.  And by not doing so, they've now contributed to the false--but titillating and dramatic!--storyline they seem so eager to push.

I don't know if they just think it's what their readers want to hear, or if they think their readers are just too stupid to notice.  I would assume, however, that the Military Times realizes that, while most of their subscribers older and white, the majority of their young, under-represented active duty readers likely pick up copies at the AAFES cash register--and don't receive them via subscriptions.  Personally, I used to read the paper version of the Army Times every week.  But I've never met anyone with a subscription.  

Regardless, by being so careless, they've done a disservice to both the military and its new Commander-in-Chief.  If they're going to conduct self-selecting polls like these, they need to quit promoting them as representative of the entire military.  Because they're not.

Brandon Friedman :: Military Times Damages Credibility by Promoting Unscientific "Survey"
Tags: , , , (All Tags)
Print Friendly View Send As Email

I Saw This (4.00 / 1)
A couple of days ago, and surprise it's still there in the front page list, and after reading it thought "Oh here We go!" the freepers and 'chickenhawks' were going to read the subject line and a few sentences and go ballistic.

Funny thing I've yet seen one, though I only hit a couple of group sites to razz a handfull, postup or comment or link back to.

I'm sure it'll popup somewhere so the fun can begin!

'Hearts and Minds, "The ultimate victory will depend on the hearts and minds of the people who actually live there." -- President Lyndon Johnson


You're bad! (4.00 / 1)
...and a  very Happy New Year and Hau'oli Makahiki Ho'u to one and all!

[ Parent ]
I'm so glad you wrote this (4.00 / 1)
I saw that headline pop up in the Marine Corps Times RSS, and was disappointed. Then I read their "How we did the poll" and felt better since I could tell it was irrelevant. Still, depressing as hell that they would run such a narrow poll and as you alluded to- build negative opinion about the incoming CIC among young troops.

The Human Equation and the Theory of Speculation (4.00 / 1)
Brandon: Wow !Great story and thank you vetvoice!

"Kepler discovered a pattern, his discovery inspired Newton to find an explantion for this remarkable simplicity-the math laws that govern gravity AND motion. It began with Brahe in 1566 as he saw Mars, Kepler in 1608 re-saw Mars and Newton put it all together an demonstrated a model for good science-
"gather data, identify patterns then find a mechanism to explain them" wrote Mark Buchanan in his recent book "The Social Atom".

Surveys are about telling the truth at that point in time.Anything less is not science...its science-fiction, plus or minus 3 %.

Today I got off the phone to "collect data "on veterans in my area on welfare.The State Welfare PAO told me they don't collect that information.  How can a homeless manager at the Va go to Congress and "predict" out-comes when the data is not available at "the begining" of the element? I then  asked the VA for "data" to tell me  the  number from 200,000 Homeless veterans from 1997 to 2007  that have moved up in the community?  I got a scientific answer of "around" 10,000 plus, when pressed, I was told they don't know? They don't keep that information! I want to prevent just one-veteran (casacade)from being homeless and the data to do that is not in the equations?

As Dixy Lee Ray once wrote, "the general public has long been divided  into two parts: those who think that science can do anything, and those who are afraid it will".

Global Mahalo's from Hawaii and to our 300,000 serving please stay safe and come home!


One thing yhat continues to irk me (4.00 / 1)
The 16-month timetable was requested by PM Maliki.  Obama didn't just pull it out of his ass.  This is what the Iraqi government asked for.  A spokesman for the Iraqi government also stated that the SOFA would not have been passed by the Iraqi parliament if a republican would have been elected, because they did not expect them to honor it.

"No U.S. soldier ever dies in vain because they're carrying out the missions of their commander in chief. And we honor all the service that they've provided." - Barack Obama

Uh, you might be missing the point, Elaine. (4.00 / 1)
I think this gem from Donnelly is priceless:

...the number of discharges under "don't ask, don't tell" could be reduced to near zero if induction forms contained a question about sexual preference.

In other words, if we can ask and then make people tell, Donnelly thinks we can use Don't Ask, Don't Tell to keep gay people from serving. Clearly, we're dealing with some stunning logical prowess here. She's actually saying that all we have to do is ignore the wording and the spirit of the law, and we can get whatever we want. With a moral code and a mind for jurisprudence like that, she must be absolutely brokenhearted to see Team Bush leave office.

By the way, her bio says that she attended Schoolcraft College--was she in some sort of pencil making apprenticeship? How the hell did this person become a recognized authority on anything, let alone military matters? I'm going to re-watch the clip of Patrick Murphy kicking her ass to feel better.


Open Thread by default ;) (4.00 / 1)
Hey Brandon;

Because you love these kinds of folks;

http://www.redstate.com/tags/t...

Background on the guy;

http://www.erickerickson.org/b...

They even created their own "unit crest;"

http://images.redstate.com/str...

Someone could do a graduate thesis with this material.


I love this video... (4.00 / 2)

...and this seems to be a great place for it. Rep. Patrick Murphy slamming the aforementioned Elaine Donnelly about DADT.

http://www.youtube.com/watch?v...

Oh and for those of you that don't know Ms. Donnelly well, you should read some of her stuff.


VetVoice on Social Media
Follow rockrichard on Twitter

VoteVets.org on Facebook
  • VetVoice Recommends

    "The War I Always Wanted,"
    By Brandon Friedman

    "The welcome mat for memoirs by veterans of operations Iraqi Freedom and Enduring Freedom might never wear out so long as they write with the savvy of Brandon Friedman . . . Friedman's take is vivid, frank, precise and dramatic." --Military Times

    "Add Brandon Friedman's The War I Always Wanted to the ranks of outstanding non-fiction produced by officers from elite combat units in the Iraq and Afghanistan wars. Always truthful, often excruciatingly so, The War I Always Wanted rises at numerous points to the level of literature." --Steven Pressfield, author of Gates of Fire

    Buy The War I Always Wanted here.

    "A Time To Lead,"
    By General (Ret.) Wesley K. Clark

    "A Time To Lead confirms the rewarding benefits of military service at a time when such service is experiencing considerable strain. It also includes a comprehensive description of America's current national imperatives, which deserve serious consideration." --General Alexander M. Haig, Jr., former Secretary of State

    "This is a primer on leadership forged in battle and by decades of experience. . .This isn't just a book; it's a manual for leading people and living a good life." --Barry McCaffrey, General, USA (ret.)

    Buy A Time to Lead here.

    "Love My Rifle More Than You,"
    By Kayla Williams

    "Whip smart, sassy, with a mouth as foul as a sailor's, 28-year-old Sergeant Kayla Williams. . .tells what it's like to be a female soldier in Iraq." --Booklist

    ". . .echoes military memoirists from Julius Caesar to Ernie Pyle." --Publishers Weekly

    ". . .a shocking, on-the-ground view of one military woman's experience in Iraq." --Bookmarks Magazine

    Buy Love My Rifle More Than You here.

    "How to Break a Terrorist,"
    By Matthew Alexander

    "...a riveting, fast-paced account that reads like a first-rate thriller." --Publisher's Weekly

    " ...an absorbing behind-the-scenes look at the secret intelligence war within a war." --Military.com

    Buy How to Break a Terrorist here.

    Search

    Advanced Search

    RSS Feed Links

    Subscribe to VetVoice in a feed reader!

    Subscribe to VetVoice by Email!

    Diaries and comments at VetVoice do not necessarily represent the views of VoteVets.org. VetVoice will strive to remove any illegal material as soon as it is flagged. Similarly, VetVoice will use its discretion in determining whether to remove exceedingly offensive material. However, between posting and removal, any offensive or illegal material does not reflect the condoning or endorsing of said material by VoteVets.org or VetVoice.
    Similarly, the views expressed on this website are those of the authors alone. Opinions on this website do not necessarily represent the views of the Department of Defense or any of its components.
    Menu

    Front Page Writers
    PTSD Resources
    TBI Resources
    IRR Information
    Casualty Reports
    VA Information
    Support the Troops
    Veteran Candidates We Support
    Congressional Committees
    Contact Your Elected Leaders
    Sites We Like

    Paid for VoteVets Political Action Committee. Not authorized by any candidate or candidate's committee. VoteVets Action Fund is a 501(c)(4) organization which primarily focuses on nonpartisan education and advocacy on behalf veterans and their families. VoteVets Political Action Committee is a federal political committee which primarily helps elect Iraq and Afghanistan war veteran candidates and educates about veterans and military issues aimed at influencing the outcome of the next election.

    Site Design: Articulated Man

    VoteVets Political Action and Vote Vets Action Fund are separate organizations.

    Powered by: SoapBlox