FND-Cargo Cult
Cargo Cult Science
(Cargo Cult science, Cargo Cult bioinformatics)
Abstract:
Not all activities lead to valuable outcomes and "Cargo Cult Science" is an important metaphor for a class of conceptual problems that are the hallmark of "poor science". The particular issue is that activites are causally disconnected from their claimed beneficial outcomes.
|
Objectives:
|
Outcomes:
|
Deliverables:
Prerequisites:
You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:
- Inquiry: The scientific method; evidence based reasoning; how to design, execute and document an experiment; Conjecture, hypothesis and theory.
Evaluation
Evaluation: NA
Contents
The concept of Cargo cult science was popularized by Richard Feynman in his 1974 Caltech Commencement address. In a nutshell, Feynman pointed out how scientific practices that lack "scientific integrity" are similar to the activities of a premodern spiritual cult in the South Sea islands that developed rituals for attracting goods-bearing supply airplanes by building mock airports.
The essence of Cargo Cult is not merely poor science. What makes it "Cargo Cult" is a disconnect between form and contents: the form is compelling, but there can't be a rational expectation of a benefit from the activity because there is no causal connection between the activity and the claimed outcome. This is often, but not always due to logical fallacies.
The topic is interesting for bioinformatics because the deficiencies are often subtle, and hard for the non-expert to spot. To guard against Cargo Cult takes integrity, and practice. A structured approach may be helpful that first clearly identifies the hoped-for outcome, then defines the proposed activities, then asks in specific detail how the outcome would be caused by the activity. Causation is key here - many examples of Cargo Cult behaviour are based on a mistaken belief in causation, where actually merely a correlation was observed. But you have to be careful: the fact that causation has not been shown does not prove it is absent. And even if causation is absent, that does not automatically make the behaviour invalid: sometimes you are right for the wrong reason. Both cases are not Cargo Cult. Rather, it is characteristic for situations we should label as Cargo Cult that there "is no cargo in the system": you are looking in the wrong place, you don't have a control or reference value, you don't understand your data - or similar problems.
Task:
- Read a brief introduction to ideas about "Cargo Cult Bioinformatics".
- Visit the Student Wiki: Cargo_Cult_Science page (and its associated Student Wiki: Not_(quite)_Cargo_Cult_Science page) on the Student Wiki and add an example of your own that you have encountered during your studies or elsewhere[1].
- Also, add to the discusssion of any of the existing examples. Comments that question whether the example actually should be called Cargo Cult, and that lead to improved focus and clarification are especially valuable.
Further reading, links and resources
Notes
- ↑ Make sure your example has not already been posted by someone else - it would be Cargo Cult to post it again.
About ...
Author:
- Boris Steipe <boris.steipe@utoronto.ca>
Created:
- 2017-08-05
Modified:
- 2020-09-17
Version:
- 1.2
Version history:
- 1.2 Maintenance
- 1.1 Add references to logical fallacies; review older submissions and move some into Not (quite) Cargo Cult page.
- 1.0 Completed to first live version
- 0.1 Material collected from previous tutorial
This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.
