User:Boris/Cargo Cult Course Component

A "Cargo Cult" Course component

This course component will teach students to identify and correct "Cargo Cult Science", in Data Science and elsewhere.

 

 

Showcase

Course goals

Be able to identify and correct "Cargo Cult Science", in Data Science and elsewhere.

Learning outcomes

• Search for and identify examples;
• Analyze;
• Review;
• Propose remedies.

Assessment highlight

From identifying individual problems of Cargo Cult behaviour, jointly build a typology.

Evaluation highlight

Self-assess a student's formal review of en example and the proposed solution; refer to grading rubrics and to peer-authored reviews.

Anticipated challenge

What to do if students don't "get it" and fail to find an example?

 

Components

Outcome

Be able to identify and correct "Cargo Cult Science", in Data Science and elsewhere.

Formative Assessment

Review examples and identify types of Cargo Cult behaviour.

Summative Assesment

Review an example, analyze the problems and propose corrections.

Learning Activities

• Listen to an introduction
• Discuss examples
• Find your own example
• Discuss, and attempt a typology of problems
• Formally review an example
• Evaluate reviews
• Propose improvements

 

In-class / Out-of class Activities

Class session 1

• Introduce the concept
• Discuss, and produce mind-map
• Present and discuss two examples
• Discuss and Update mind-map
• TPS: how to find examples
• Report back.

 

Between classes

• Find and post two examples of Cargo Cult-type problems in published (research) activities

 

Class session 2

• Jointly analyze two examples
• Individually analyze one example each
• Collect identified issues
• Summarize into a typology of problems

 

Between classes

• Review three examples

 

Class session 3

• Review two reviews
• Individually review one review each
• Report back: problems?

 

After classes

• Formally review one example
• Also propose improvements
• Self-assess from rubrics, and the other previously submitted reviews

• Grades are given on the self-assessed review

 

Course framework

 

Week 1

Outcomes

• Understand the problem as evidence by being able to find examples.

 

Week 2

Outcomes

• Abstarct the issues and organize the abstractions.

 

Week 3

Outcomes

• Apply the abstractions in review and propose remedies.

 

Notes