[Jdm-society] replications

[Robyn Dawes]

Irwin,  What the "real" scientists do is to futch around until they get i
"right."  The multiple study requirement just adds "first and second and
third" studies, thereby wasting space and time.

Robyn


On 5/5/07 1:59 PM, "irwin-levin at uiowa.edu" <irwin-levin at uiowa.edu> wrote:

> Hi.
> I think this dialog is a great example of how we can use the SJDM list
> to address an issue that affects virtually all of us.
> A couple minor points to add:
>   1. A "failure to replicate" may sometimes be caused by going too far
> beyond the original operational definitions and boundary conditions.
> The Levin, Schneider & Gaeth '98 OBHDP paper, "All frames are not
> created equal" was all about that.
>   2. A number of major journals call for multiple experiments in one
> paper. I think that this can sometimes go too far by delaying
> publication of provocative results, but it does relate to the current
> issue in that the latter experiments in a series are often part
> replication and part extension of the earlier experiments.
> Irwin
> 
> Quoting David Budescu <dbudescu at cyrus.psych.uiuc.edu>:
> 
>> 
>> Jon should be congratulated for his editorial policy, but I still
>> predict that we'll see relatively few "straight" replications (fully or
>> partially successful) in press.  Part of the problem is that the incentive
>> structure in our profession is biased against this.  We value innovation,
>> originality and creativity and we reward them. Replications are often
>> dismissed as "more of the same" or "lacking any new ideas".
>> 
>> Besides the obvious element of self-selection (recall why most of us got
>> into this business), this attitide permeates our institutions.
>> This may not be always stated explicitly, but it is implicit in
>> choices made under limited resources (given a fixed amount of grant
>> money to distribute, or a limited number of journal pages to fill, granting
>> agencies and journal editors favor new "exciting" ideas, even if they
>> recognize, and pay lip service, to the importance of replications).
>> And, think of hiring and promotion committees...
>> 
>> David
>> 
>> 
>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>> | David V. Budescu     |
>> | Department of Psychology, University of Illinois |
>> | 603 E. Daniel Street, Champaign, IL 61820  |
>> | Tel (217) 333 6758 or (217) 840 1586   |
>> | Fax (217) 244 5876 Email: dbudescu at uiuc.edu  |
>> | http://www.psych.uiuc.edu/~dbudescu    |
>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>> _______________________________________________
>> Jdm-society mailing list
>> Jdm-society at mail.sjdm.org
>> http://www.sjdm.org/mailman/listinfo/jdm-society
>> 
> 
> 
> 
> _______________________________________________
> Jdm-society mailing list
> Jdm-society at mail.sjdm.org
> http://www.sjdm.org/mailman/listinfo/jdm-society
>