Magic Statistics

“I accept no responsibility for statistics, which are a form of magic beyond my comprehension.” — Robertson Davies

March 14th, 2006 at 9:58 pm

Survey of ECUSA House of Bishops

A survey consisting of three questions has been sent to all members of the House of Bishops of the Episcopal Church (ECUSA). Sponsored by a hitherto-unknown group called Lay Episcopalians for the Anglican Communion (LEAC), the survey arrived with a cover letter of support from former Archbishop of Canterbury George Carey.

The text of the three questions reads:

QUESTION 1. If you were to vote today in SECRET balloting on whether you NOW would prefer that General Convention 2003 had or had not approved a measure supporting consecration of The Rev V. Gene Robinson, how would you vote?

two response choices: prefer approval / prefer disapproval

A supplementary question asks whether or not the respondent voted on this at General Convention 2003.

QUESTION 2. If you were to vote today in SECRET balloting on whether you NOW would prefer that General Convention 2003 had or had not allowed Episcopal Church measures permitting procedures for priests to bless or officially recognize same-sex domestic partners, how would you vote?

two response choices: prefer approval / prefer disapproval

A supplementary question asks whether or not the respondent voted on this at General Convention 2003.

QUESTION 3. Is your desire to remain personally in the Anglican Communion stronger than your desire for solidarity within ECUSA, whether or not ECUSA is in the communion?

two response choices: yes / no

An introductory letter assures respondents that the survey is “blind, confidential, and anonymous”. The objective of the survey is “bringing and holding together as many Episcopalians as possible in a single, diverse, inclusive province of the Anglican Communion”.

Scanned copies of the survey’s two pages and Lord Carey’s cover letter are posted here.

The survey has provoked ECUSA Presiding Bishop Frank Griswold to discourage bishops from participating in the survey and to protest to Lord Carey for endorsing it.

In an e-mail dated March 8, Bishop Griswold said he was “suspicious of anything that is anonymous and that the questions themselves lead me to believe the intention of those who have asked [Archbishop Carey] to circulate the questionnaire is far from benign.”

Jim Ince of Bethesda, Md., one of the organizers, defends the survey:

“I think it is an interesting and good idea to see where things are,” he said, noting “we will do everything with truth and clarity.”
. . .
Mr. Ince said the authors of the questionnaire were a “lay-led group” that was “responding to the pleas from all sides” for honest conversation within the Episcopal Church.
. . .
Mr. Ince said frustration with the opacity of the deliberations and the lack of leadership from the Episcopal Church’s hierarchy prompted the questionnaire. “The clergy just don’t want to get involved in anything,” he said.

I certainly sympathise with the desire to get honest opinions out in the open in hopes of breaking through the impasse. However, I’m afraid that this survey will not succeed in accomplishing that purpose.

From the perspective of technical statistics, anonymous surveys are a very bad idea. Confidentiality is a must, of course, but anonymity is counter-productive because that makes it impossible to control survey operations and to conduct an intelligent analysis.

Mail-out surveys like this one can be set aside by respondents to be done later, and then forgotten or misplaced. If addressed to a business office, the survey may not even reach the intended recipient. Follow-up, usually by telephone, is necessary to contact those who have not responded, let them know how important their response is, and hopefully persuade them to fill out the survey.  Obviously, that cannot be done if there is no list of non-respondents.

When it comes time for analysis of results, moreover, it is essential to know who answered and who didn’t in order properly to assess the returns that came in.

The surveyors would have done much better to hire a professional and respected public-opinion polling firm to design and conduct the survey. The questions would have been written and tested by professionals. The completed surveys could have been sent directly to the polling firm instead of LEAC, a group that no one really knows anything about. That would have improved the survey’s credibility and, I think, confirm that LEAC is really serious about this project.

Setting aside statistical matters, it seems to me also that those who support ordination of Bp Robinson and blessing of same-sex unions have no incentive to complete the survey. They have nothing to gain. Their interest clearly lies with minimizing the number of surveys returned. Indeed, Bp Griswold supports exactly that tactic. All non-respondents will, rightly in my view, be assumed to support the ECUSA status quo on those issues.

Living Church link via titusonenine.

Print This Post Print This Post
March 14th, 2006 at 7:16 pm

Mark Steyn in the British press

Following up on yesterday's post, I see that Giraldus Cambrensis at Western Resistance thinks Mark Steyn's exit from the London Telegraph had something to do with the Telegraph's new ownership. (Scroll down to the bottom of the post.) It's a little convoluted but, if I understand Mr Cambrensis correctly, Mr Steyn left not because Sir David and Sir Frederick Barclay, the newspaper's new owners, want to curry favour with their Muslim business friends, but rather because Andrew Neil, the new editor-in-chief of Press Holdings (the Barclay Brothers' holding company), wants a peerage.

Wait, Tim Worstall has a rather simpler hypothesis: maybe Mr Steyn is gone because he didn't "suck up to the Barclay brothers enough".

What of Mr Steyn's future in British newspapers? My commenter Prasenjeet Dutta points to a page at Pajamas Media that points to a blog post suggesting that Mark Steyn may soon appear in the opinion columns of The Guardian. That really got the blogosphere buzzing, but it was all a put-on. (I knew that!)

Mark Steyn says (at the bottom of the page) that the Telegraph still owes him money, but doesn't say if that bears on his leaving the newspaper. In any case, he thinks he'll be back in the British press soon: "I wouldn’t be surprised to get the odd tinkle from Fleet Street before too long." Whaddya bet that tinkle comes from The Guardian?

Previous related post: Steyn dumped by Telegraph and UK Spectator.

Print This Post Print This Post
|