Deconstructing and Deep-Drilling* 2

Constructing Thebes Library: 2002

Deconstructing: The deconstructionist idea, initially associated with French philosophers like Derrida, and literary theory, denies that a “text” has a single interpretation, intended by the author, but rather that the reader constructs its meaning, unearthing conscious or unconscious significations. While the general philosophy is linked with relativism, postmodernism, and social constructivism---positions to which I am highly allergic---one needn’t embrace them to accord validity to the activity of disinterring meanings: ironies, deceptions, and unintended assumptions and twists in an author’s writing. The passage I cited from Berger seems to offer an example for creative deconstruction of the statistical kind. I wouldn’t have proposed the exercise if I didn’t suspect we might learn something of relevance to our deep-sea drilling activity…. Please continue to send your ponderings….

*DO stock is nearly at a year low! (I surmise a fairly quick trip back up 10 points)

Done!

The hole in Birnbaum's famous (alleged) proof of the Likelihood Principle has withstood a rather severe test of a knowledgeable (mostly Bayesian leaning) audience at a conference on controversies in statistical hypothesis testing (Testing2011, Madrid).  Thanks for various e-mail comments/corrections on the blogposted draft (Dec 6-7), to Santiago and Casa de Madrid*!

*and of course to the main conference organizer, David Tiera.

Irony and Bad Faith: Deconstructing Bayesians 1

Some time in 2006 (shortly after my ERROR06 conference), the trickle of irony and sometime flood of family feuds issuing from Bayesian forums drew me back into the Bayesian-frequentist debates.^{1 2}  Suddenly sparks were flying, mostly kept shrouded within Bayesian walls, but nothing can long be kept secret even there. Spontaneous combustion is looming. The true-blue subjectivists were accusing the increasingly popular “objective” and “reference” Bayesians of practicing in bad faith; the new O-Bayesians (and frequentist-Bayesian unificationists) were taking pains to show they were not subjective; and some were calling the new Bayesian kids on the block “pseudo Bayesian.” Then there were the Bayesians somewhere in the middle (or perhaps out in left field) who, though they still use the Bayesian umbrella, were flatly denying the very idea that Bayesian updating fits anything they actually do in statistics.³ Obeisance to Bayesian reasoning remained, but on some kind of a priori philosophical grounds. Doesn’t the methodology used in practice really need a philosophy of its own? I say it does, and I want to provide this. 

Tapping through philosophical minefields

Well I finally did it!  After weeks of passing by tap classes at Pineapple Dance Studio in London (a main reason I arranged an apt in Covent Garden to begin with) I successfully made it through a Derek Hartley tap class (“elementary”).   First time since the bizarre knee injury of October (doctors never did say just when I could go back).  It’s quite amazing to walk in off the street, and see he is doing exactly what I have seen him do for years---teaching super-cool jazz-tap routines, telling the same tap jokes, and dancing just as great as ever!  Mind-altering to find myself tapping to a smooth and jazzy “Lullaby of Birdland” again,(a favorite).  Limping just a little, but exhilarated.  Now it's back to tapping my way through philosophical minefields, or perhaps, pirouetting (as Christian Robert put it).

I don’t know why some of the pictures on this blog do not appear on some devices---need the Elba crew to get to the bottom of this.  I’ll be traveling back there soon enough….

Part II: Breaking Through the Breakthrough* (please start with Dec 6 post)

This is a first draft of part II of the presentation begun in the December 6 blogpost.  This completes the proposed presentation. I expect errors, and I will be grateful for feedback! (NOTE: I did not need to actually rip a cover of EGEK to obtain this effect!)

SEVEN: NOW FOR THE BREAKTHROUGH

You have observed y”, the .05 significant result from E”, the optional stopping rule, ending at n = 100.

Birnbaum claims he can show that you, as a frequentist error statistician, must grant that it is equivalent to having fixed n= 100 at the start (i.e., experiment E’)

Reminder:

The (strong) Likelihood Principle (LP) is a universal conditional claim:

If two data sets y’ and y” from experiments E’ and E” respectively, have likelihood functions which are functions of the same parameter(s) µ

and are proportional to each other, then y’ and y” should lead to identical inferential conclusions about µ.

As with conditional proofs, we assume the antecedent and try to derive the consequent, or equivalently, show a contradiction results whenever the antecedent holds and the consequent does not (reductio proof).

Putting the Brakes on the Breakthrough Part I*

I am going to post a FIRST draft (for a brief presentation next week in Madrid).  [I thank David Cox for the idea!] I expect errors, and I will be very grateful for feedback!  This is part I; part II will be posted tomorrow.  These posts may disappear once I've replaced them with a corrected draft.  I'll then post the draft someplace.

  If you wish to share queries/corrections please post as a comment or e-mail: error@vt.edu.  (ignore Greek symbols that are not showing correctly, I await fixes by Elbians.) Thanks much!

ONE: A Conversation between Sir David Cox and D. Mayo (June, 2011)

Toward the end of this exchange, the issue of the Likelihood Principle (LP)[1] arose:

COX: It is sometimes claimed that there are logical inconsistencies in frequentist theory, in particular surrounding the strong Likelihood Principle (LP). I know you have written about this, what is your view at the moment.

MAYO: What contradiction?

Getting Credit (or blame) for Something You Don't Deserve (and first honorable mention)

Ruler at the Bottom of Ocean

It was three months ago that I began this blog with “overheard at the comedy hour at the Bayesian retreat” …and we’re near the end of the repertoire of jokes (unless I hear any new ones).  This last, in effect, accuses the frequentist error-statistical account of licensing the following (make-believe) argument after the oil spill in the Gulf of Mexico in 2010:

  Oil Exec: We had highly reliable evidence that H: the pressure was at normal levels on April 20, 2010!

Senator: But you conceded that whenever your measuring tool showed dangerous or ambiguous readings, you continually lowered the pressure, and that the stringent “cement bond log” test was entirely skipped. 

If you try sometime, you find you get what you need!

picking up the pieces

Thanks to Nancy Cartwright, a little ad hoc discussion group has formed: “PhilErrorStat: LSE: Three weeks in (Nov-Dec) 2011.”  I’ll be posting related items on this blog, in the column to your left, over its short lifetime. We’re taking a look at some articles and issues leading up to a paper I’m putting together to give in Madrid next month on the Birnbaum-likelihood principle business (“Breaking Through the Breakthrough”) at a conference (“The Controversy about Hypothesis Testing,” Madrid, December 15-16, 2011).  I hope also to get this group’s feedback as I follow through on responses I’ve been promising to some of the comments and queries I’ve received these past few months.  

Our very first meeting already reminded me of an issue Christian Robert raised in his blog about Error and Inference: Is the frequentist (error-statistical) interest in probing discrepancies, and the ways in which statistical hypotheses and models can be false, akin to a Bayesian call for setting out rival hypotheses with prior probability assignments?

The UN Charter: double-counting and data snooping

John Worrall, 26 Nov. 2011

Last night we went to a 65th birthday party for John Worrall, philosopher of science and guitarist in his band Critique of Pure Rhythm. For the past 20 or more of these years, Worrall and I have been periodically debating one of the most contested principles in philosophy of science: whether evidence in support of a hypothesis or theory should in some sense be “novel.”

A novel fact for a hypothesis H may be: (1) one not already known, (2) one not already predicted (or counter-predicted) by available hypotheses, or (3) one not already used in arriving at or constructing H. The first corresponds to temporal novelty (Popper), the second, to theoretical novelty (Popper, Lakatos), the third, to heuristic or use-novelty. It is the third, use-novelty (UN), best articulated by John Worrall, that seems to be the most promising at capturing a common intuition against the “double use” of evidence:

If data x have been used to construct a hypothesis H(x), then x should not be used again as evidence in support of H(x).

(Note: Writing H(x) in this way emphasizes that, one way or another, the inferred hypothesis selected or constructed to fit or agree with data x. The particular instantiation can be written as H(x₀).)

The UN requirement, or, as Worrall playfully puts it, the “UN Charter,” is this:

Use-novelty requirement (UN Charter): for data x to support hypothesis H (or for x to be a good test of H), H should not only agree with or “fit” the evidence x, but x itself must not have been used in H's construction.

The problem has arisen as a general prohibition against data mining, hunting for significance, tuning on the signal, ad hoc hypotheses, and data peeking, and as a preference for predesignated hypotheses and novel predictions.

Elbar Grease: Return to the Comedy Hour at the Bayesian Retreat

I lost a bet last night with my criminologist colleague Katrin H. It turns out that you can order a drink called “Elbar Grease” in London, in a “secret” comedy club in a distant suburb (see Sept. 30 post).[i] The trouble is that it’s not nearly as sour as the authentic drink (not sour enough, in any case, for those of us who lack that aforementioned gene). But I did get to hear some great comedy, which hasn’t happened since early days of exile, and it reminded me of my promise to revisit the “comedy hour at the Bayesian retreat” (see Sept. 3 post). Few things have been the butt of more jokes than examples of so-called “trivial intervals”.