Expected Preparations:

  Calculus:
Functions and equations; Polynomial functions, logarithms, trigonometric functions; Integrals and derivatives; Theorem and proof.
   Geometry:
Length, area, volume; Euclidian and non-Euclidian space.
   Probability:
Event; Probability; Hypothesis and significance.
   Physical chemistry:
Kinetics, transition states, and equilibria; Enthalpy, entropy, and free energy; Boltzmann’s law.
   [BIN]
Sequence 		 
  If you are not already familiar with the prior knowledge listed above, you need to prepare yourself from other information sources.   The units listed above are part of this course and contain important preparatory material.  
Keywords: Information theory
Objectives:

This unit will …

  • … introduce concepts of the foundations of information theory and its application to amino acid distributions.

 Outcomes:

After working through this unit you …

  • … can calculate the informational entropy in a distribution of observed amino acids;

  • … are familar with various ways to define the informational entropy of reference distributions;

  • … can calculate information as the difference between expected and observed entropy.

Deliverables:

Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.

Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don’t overlook these.

Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.

Evaluation:

NA: This unit is not evaluated for course marks.

Contents

A brief introduction to entropy and information: information theory appled to amino acid disributions.

Task…

Questions, comments

If in doubt, ask! If anything about this contents is not clear to you, do not proceed but ask for clarification. If you have ideas about how to make this material better, let’s hear them. We are aiming to compile a list of FAQs for all learning units, and your contributions will count towards your participation marks.

Improve this page! If you have questions or comments, please post them on the Quercus Discussion board with a subject line that includes the name of the unit.

References

Page ID: FND-STA-Information_theory

Author:
Boris Steipe ( <boris.steipe@utoronto.ca> )
Created:
2017-08-05
Last modified:
2022-09-14
Version:
1.1
Version History:
–  1.1 2020 Maintenance
–  1.0 First live version
–  0.1 First stub
Tagged with:
–  Unit
–  Live
–  Has lecture slides

 

[END]