Difference between revisions of "BIN-EXPR-Multiple testing"

From "A B C"
Jump to navigation Jump to search
m
m
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
<div id="BIO">
+
<div id="ABC">
−
  <div class="b1">
+
<div style="padding:5px; border:1px solid #000000; background-color:#b3dbce; font-size:300%; font-weight:400; color: #000000; width:100%;">
 
Multiple Testing and Significance
 
Multiple Testing and Significance
−
  </div>
+
<div style="padding:5px; margin-top:20px; margin-bottom:10px; background-color:#b3dbce; font-size:30%; font-weight:200; color: #000000; ">
−
 
+
(Multiple testing problem. Concepts, Bonferroni correction and FDR)
−
  {{Vspace}}
+
</div>
−
 
 
−
<div class="keywords">
 
−
<b>Keywords:</b>&nbsp;
 
−
Multiple testing problem. Concepts, Bonferroni correction and FDR
 
 
</div>
 
</div>
  
−
{{Vspace}}
+
{{Smallvspace}}
−
 
 
−
 
 
−
__TOC__
 
−
 
 
−
{{Vspace}}
 
−
 
 
−
 
 
−
{{STUB}}
 
−
 
 
−
{{Vspace}}
 
  
  
−
</div>
+
<div style="padding:5px; border:1px solid #000000; background-color:#b3dbce33; font-size:85%;">
−
<div id="ABC-unit-framework">
+
<div style="font-size:118%;">
−
== Abstract ==
+
<b>Abstract:</b><br />
 
<section begin=abstract />
 
<section begin=abstract />
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "abstract" -->
+
Searching for significant effects in high-throughput experiments changes the statistical odds of finding highly unusual outcomes. This needs to be properly corrected, especially in situations like expression analysis where we observe tens of thousands of measurements simultaneously and need to determine which ones should be followed up on.
−
...
 
 
<section end=abstract />
 
<section end=abstract />
−
 
+
</div>
−
{{Vspace}}
+
<!-- ============================  -->
−
 
+
<hr>
−
 
+
<table>
−
== This unit ... ==
+
<tr>
−
=== Prerequisites ===
+
<td style="padding:10px;">
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "prerequisites" -->
+
<b>Objectives:</b><br />
−
<!-- included from "ABC-unit_components.wtxt", section: "notes-prerequisites" -->
+
This unit will ...
−
You need to complete the following units before beginning this one:
+
* ... introduce the concepts of probability correction with Family Wise Error rate and False Discovery Rate.
 +
</td>
 +
<td style="padding:10px;">
 +
<b>Outcomes:</b><br />
 +
After working through this unit you ...
 +
* ... are aware of the need to correct significance levels in situations with multiple observations;
 +
* ... are familar with the ideas of the Bonferroni correction and control with the False Discovery Rate (FDR).
 +
</td>
 +
</tr>
 +
</table>
 +
<!-- ============================ -->
 +
<hr>
 +
<b>Deliverables:</b><br />
 +
<section begin=deliverables />
 +
<li><b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.</li>
 +
<li><b>Journal</b>: Document your progress in your [[FND-Journal|Course Journal]]. Some tasks may ask you to include specific items in your journal. Don't overlook these.</li>
 +
<li><b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|'''insights!''' page]].</li>
 +
<section end=deliverables />
 +
<!-- ============================  -->
 +
<hr>
 +
<section begin=prerequisites />
 +
<b>Prerequisites:</b><br />
 +
This unit builds on material covered in the following prerequisite units:<br />
 
*[[BIN-EXPR-DE|BIN-EXPR-DE (Discovering Differentially Expressed Genes)]]
 
*[[BIN-EXPR-DE|BIN-EXPR-DE (Discovering Differentially Expressed Genes)]]
 
*[[FND-STA-Significance|FND-STA-Significance (Significance)]]
 
*[[FND-STA-Significance|FND-STA-Significance (Significance)]]
 +
<section end=prerequisites />
 +
<!-- ============================  -->
 +
</div>
  
−
{{Vspace}}
+
{{Smallvspace}}
−
 
 
  
−
=== Objectives ===
 
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "objectives" -->
 
−
...
 
  
−
{{Vspace}}
 
  
 +
{{Smallvspace}}
  
−
=== Outcomes ===
 
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "outcomes" -->
 
−
...
 
  
−
{{Vspace}}
+
__TOC__
−
 
 
−
 
 
−
=== Deliverables ===
 
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "deliverables" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-time_management" -->
 
−
*<b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-journal" -->
 
−
*<b>Journal</b>: Document your progress in your [[FND-Journal|Course Journal]]. Some tasks may ask you to include specific items in your journal. Don't overlook these.
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-insights" -->
 
−
*<b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|'''insights!''' page]].
 
  
 
{{Vspace}}
 
{{Vspace}}
Line 73: Line 66:
  
 
=== Evaluation ===
 
=== Evaluation ===
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "evaluation" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "eval-none" -->
 
 
<b>Evaluation: NA</b><br />
 
<b>Evaluation: NA</b><br />
−
:This unit is not evaluated for course marks.
+
<div style="margin-left: 2rem;">This unit is not evaluated for course marks.</div>
−
 
 
−
{{Vspace}}
 
−
 
 
−
 
 
−
</div>
 
−
<div id="BIO">
 
 
== Contents ==
 
== Contents ==
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "contents" -->
+
{{Smallvspace}}
−
...
+
{{Task|1=
 +
*Read the introductory notes on {{ABC-PDF|BIN-EXPR-Multiple_testing|multiple testing}}.
 +
}}
  
 
{{Vspace}}
 
{{Vspace}}
−
 
−
 
−
== Further reading, links and resources ==
 
−
<!-- {{#pmid: 19957275}} -->
 
−
<!-- {{WWW|WWW_GMOD}} -->
 
−
<!-- <div class="reference-box">[http://www.ncbi.nlm.nih.gov]</div> -->
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
== Notes ==
 
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "notes" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "notes" -->
 
−
<references />
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
</div>
 
−
<div id="ABC-unit-framework">
 
−
== Self-evaluation ==
 
−
<!-- included from "../components/BIN-EXPR-Multiple_testing.components.wtxt", section: "self-evaluation" -->
 
−
<!--
 
−
=== Question 1===
 
−
 
−
Question ...
 
−
 
−
<div class="toccolours mw-collapsible mw-collapsed" style="width:800px">
 
−
Answer ...
 
−
<div class="mw-collapsible-content">
 
−
Answer ...
 
−
 
−
</div>
 
−
  </div>
 
−
 
−
  {{Vspace}}
 
−
 
−
-->
 
  
 
{{Vspace}}
 
{{Vspace}}
  
−
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
<!-- included from "ABC-unit_components.wtxt", section: "ABC-unit_ask" -->
 
−
 
−
----
 
−
 
−
{{Vspace}}
 
−
 
−
<b>If in doubt, ask!</b> If anything about this learning unit is not clear to you, do not proceed blindly but ask for clarification. Post your question on the course mailing list: others are likely to have similar problems. Or send an email to your instructor.
 
−
 
−
----
 
−
 
−
{{Vspace}}
 
  
 
<div class="about">
 
<div class="about">
Line 154: Line 87:
 
:2017-08-05
 
:2017-08-05
 
<b>Modified:</b><br />
 
<b>Modified:</b><br />
−
:2017-08-05
+
:2020-09-24
 
<b>Version:</b><br />
 
<b>Version:</b><br />
−
:0.1
+
:1.1
 
<b>Version history:</b><br />
 
<b>Version history:</b><br />
 +
*1.1 Maintainance
 +
*1.0 First live version
 
*0.1 First stub
 
*0.1 First stub
 
</div>
 
</div>
−
[[Category:ABC-units]]
 
−
<!-- included from "ABC-unit_components.wtxt", section: "ABC-unit_footer" -->
 
  
 
{{CC-BY}}
 
{{CC-BY}}
  
 +
[[Category:ABC-units]]
 +
{{UNIT}}
 +
{{LIVE}}
 
</div>
 
</div>
 
<!-- [END] -->
 
<!-- [END] -->

Latest revision as of 07:08, 25 September 2020

Multiple Testing and Significance

(Multiple testing problem. Concepts, Bonferroni correction and FDR)


 


Abstract:

Searching for significant effects in high-throughput experiments changes the statistical odds of finding highly unusual outcomes. This needs to be properly corrected, especially in situations like expression analysis where we observe tens of thousands of measurements simultaneously and need to determine which ones should be followed up on.

Objectives:
This unit will ...

  • ... introduce the concepts of probability correction with Family Wise Error rate and False Discovery Rate.

Outcomes:
After working through this unit you ...

  • ... are aware of the need to correct significance levels in situations with multiple observations;
  • ... are familar with the ideas of the Bonferroni correction and control with the False Discovery Rate (FDR).

Deliverables:

  • Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
  • Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don't overlook these.
  • Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.

    • Prerequisites:
    This unit builds on material covered in the following prerequisite units:


     



     



     


    Evaluation

    Evaluation: NA

    This unit is not evaluated for course marks.

    Contents

     

    Task:


     


     


    About ...
     
    Author:

    Boris Steipe <boris.steipe@utoronto.ca>

    Created:

    2017-08-05

    Modified:

    2020-09-24

    Version:

    1.1

    Version history:

    • 1.1 Maintainance
    • 1.0 First live version
    • 0.1 First stub

    CreativeCommonsBy.png This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.

    Retrieved from "http://steipe.biochemistry.utoronto.ca/abc/index.php?title=BIN-EXPR-Multiple_testing&oldid=11653"