Difference between revisions of "FND-STA-Probability distribution"

From "A B C"
Jump to navigation Jump to search
m
m
Line 8: Line 8:
 
<div class="keywords">
 
<div class="keywords">
 
<b>Keywords:</b>&nbsp;
 
<b>Keywords:</b>&nbsp;
Nature of a probability distribution, integrals, important distributions, comparing observed and simulated probability distributions, the Kolmogorov-Smirnov test
+
Nature of a probability distribution, important distributions, comparing observed and simulated probability distributions, Kullback-Leibler diveregence, the Kolmogorov-Smirnov test.
 
</div>
 
</div>
  
Line 19: Line 19:
  
  
{{STUB}}
+
{{LIVE}}
  
 
{{Vspace}}
 
{{Vspace}}
Line 29: Line 29:
 
<section begin=abstract />
 
<section begin=abstract />
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "abstract" -->
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "abstract" -->
...
+
Probability distributions are at the core of any statistical analysis, in which modelled distributions are compared with sampled distributions to relate an observation to our theoretical understanding. This unit introduces the principles, discusses Poisson, uniform, and normal distributions, and presents methods to compare distributions with each other and quantify the difference.
 
<section end=abstract />
 
<section end=abstract />
  
Line 44: Line 44:
 
<!-- included from "ABC-unit_components.wtxt", section: "notes-prerequisites" -->
 
<!-- included from "ABC-unit_components.wtxt", section: "notes-prerequisites" -->
 
You need to complete the following units before beginning this one:
 
You need to complete the following units before beginning this one:
*[[FND-STA-Probability]]
+
*[[FND-STA-Probability|FND-STA-Probability (Probability)]]
  
 
{{Vspace}}
 
{{Vspace}}
Line 51: Line 51:
 
=== Objectives ===
 
=== Objectives ===
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "objectives" -->
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "objectives" -->
...
+
This unit will ...
 +
* ... introduce basic concepts of probability distributions;
 +
* ... demonstrate the Poisson, the uniform, and the normal distribution;
 +
* ... teach how to visually and quantitatively compare them.
  
 
{{Vspace}}
 
{{Vspace}}
Line 58: Line 61:
 
=== Outcomes ===
 
=== Outcomes ===
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "outcomes" -->
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "outcomes" -->
...
+
After working through this unit you ...
 +
* ... can interpret observed events in terms of probability distributions;
 +
* ... are familar with the Poisson, the uniform, and the normal distribution;
 +
* ... can compare observed distributions against the normal distribution with <code>qqnorm()</code>.
 +
* ... can compare observed distributions against each other with <code>qqplot()</code>.
 +
* ... can use Kullback-Leibler divergence for discrete distributions, and <code>ks.test()</code> for continuous distributions to quantify differences.
  
 
{{Vspace}}
 
{{Vspace}}
Line 88: Line 96:
 
== Contents ==
 
== Contents ==
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "contents" -->
 
<!-- included from "../components/FND-STA-Probability_distribution.components.wtxt", section: "contents" -->
...
+
 
 +
{{Smallvspace}}
 +
 
 +
{{ABC-unit|FND-STA-Probability_distribution.R}}
 +
 
 +
{{Vspace}}
 +
 
  
 
{{Vspace}}
 
{{Vspace}}
Line 159: Line 173:
 
:2017-08-05
 
:2017-08-05
 
<b>Version:</b><br />
 
<b>Version:</b><br />
:0.1
+
:1.0
 
<b>Version history:</b><br />
 
<b>Version history:</b><br />
*0.1 First stub
+
*1.0 New material
 
</div>
 
</div>
 
[[Category:ABC-units]]
 
[[Category:ABC-units]]

Revision as of 16:48, 12 October 2017

Probability Distribution


 

Keywords:  Nature of a probability distribution, important distributions, comparing observed and simulated probability distributions, Kullback-Leibler diveregence, the Kolmogorov-Smirnov test.


 



 


 


Abstract

Probability distributions are at the core of any statistical analysis, in which modelled distributions are compared with sampled distributions to relate an observation to our theoretical understanding. This unit introduces the principles, discusses Poisson, uniform, and normal distributions, and presents methods to compare distributions with each other and quantify the difference.


 


This unit ...

Prerequisites

You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:

  • Calculus: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof.

You need to complete the following units before beginning this one:


 


Objectives

This unit will ...

  • ... introduce basic concepts of probability distributions;
  • ... demonstrate the Poisson, the uniform, and the normal distribution;
  • ... teach how to visually and quantitatively compare them.


 


Outcomes

After working through this unit you ...

  • ... can interpret observed events in terms of probability distributions;
  • ... are familar with the Poisson, the uniform, and the normal distribution;
  • ... can compare observed distributions against the normal distribution with qqnorm().
  • ... can compare observed distributions against each other with qqplot().
  • ... can use Kullback-Leibler divergence for discrete distributions, and ks.test() for continuous distributions to quantify differences.


 


Deliverables

  • Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
  • Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don't overlook these.
  • Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.


 


Evaluation

Evaluation: NA

This unit is not evaluated for course marks.


 


Contents

 

Task:

 
  • Open RStudio and load the ABC-units R project. If you have loaded it before, choose FileRecent projectsABC-Units. If you have not loaded it before, follow the instructions in the RPR-Introduction unit.
  • Choose ToolsVersion ControlPull Branches to fetch the most recent version of the project from its GitHub repository with all changes and bug fixes included.
  • Type init() if requested.
  • Open the file FND-STA-Probability_distribution.R and follow the instructions.


 

Note: take care that you understand all of the code in the script. Evaluation in this course is cumulative and you may be asked to explain any part of code.


 


 


 


Further reading, links and resources

 


Notes


 


Self-evaluation

 



 




 

If in doubt, ask! If anything about this learning unit is not clear to you, do not proceed blindly but ask for clarification. Post your question on the course mailing list: others are likely to have similar problems. Or send an email to your instructor.



 

About ...
 
Author:

Boris Steipe <boris.steipe@utoronto.ca>

Created:

2017-08-05

Modified:

2017-08-05

Version:

1.0

Version history:

  • 1.0 New material

CreativeCommonsBy.png This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.