Difference between revisions of "FND-STA-Information theory"

From "A B C"
Jump to navigation Jump to search
m (Created page with "<div id="BIO"> <div class="b1"> Concepts of Information Theory </div> {{Vspace}} <div class="keywords"> <b>Keywords:</b>  Information theory, statistical mechan...")
 
m
 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
<div id="BIO">
+
<div id="ABC">
−
  <div class="b1">
+
<div style="padding:5px; border:1px solid #000000; background-color:#b3dbce; font-size:300%; font-weight:400; color: #000000; width:100%;">
 
Concepts of Information Theory
 
Concepts of Information Theory
−
  </div>
+
<div style="padding:5px; margin-top:20px; margin-bottom:10px; background-color:#b3dbce; font-size:30%; font-weight:200; color: #000000; ">
−
 
+
(Information theory)
−
  {{Vspace}}
+
</div>
−
 
 
−
<div class="keywords">
 
−
<b>Keywords:</b>&nbsp;
 
−
Information theory, statistical mechanics, Boltzmann's law, statistical free energy
 
 
</div>
 
</div>
  
−
{{Vspace}}
+
{{Smallvspace}}
−
 
 
−
 
 
−
__TOC__
 
−
 
 
−
{{Vspace}}
 
−
 
 
−
 
 
−
{{STUB}}
 
−
 
 
−
{{Vspace}}
 
  
  
 +
<div style="padding:5px; border:1px solid #000000; background-color:#b3dbce33; font-size:85%;">
 +
<div style="font-size:118%;">
 +
<b>Abstract:</b><br />
 +
<section begin=abstract />
 +
A brief introduction to entropy and information: information theory appled to amino acid disributions.
 +
<section end=abstract />
 
</div>
 
</div>
−
<div id="ABC-unit-framework">
+
<!-- ============================  -->
−
== Abstract ==
+
<hr>
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "abstract" -->
+
<table>
−
... with perspectives on statistical mechanics, Boltzmann's law and the calculation of statistical "free energy".
+
<tr>
−
 
+
<td style="padding:10px;">
−
{{Vspace}}
+
<b>Objectives:</b><br />
−
 
+
This unit will ...
−
 
+
* ... introduce concepts of the foundations of information theory and its application to amino acid distributions.
−
== This unit ... ==
+
</td>
−
=== Prerequisites ===
+
<td style="padding:10px;">
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "prerequisites" -->
+
<b>Outcomes:</b><br />
−
<!-- included from "ABC-unit_components.wtxt", section: "notes-external_prerequisites" -->
+
After working through this unit you ...
−
You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:
+
* ... can calculate the informational entropy in a distribution of observed amino acids;
−
<!-- included from "FND-prerequisites.wtxt", section: "calculus" -->
+
* ... are familar with various ways to define the informational entropy of reference distributions;
 +
* ... can calculate information as the difference between expected and observed entropy.
 +
</td>
 +
</tr>
 +
</table>
 +
<!-- ============================ -->
 +
<hr>
 +
<b>Deliverables:</b><br />
 +
<section begin=deliverables />
 +
<li><b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.</li>
 +
<li><b>Journal</b>: Document your progress in your [[FND-Journal|Course Journal]]. Some tasks may ask you to include specific items in your journal. Don't overlook these.</li>
 +
<li><b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|'''insights!''' page]].</li>
 +
<section end=deliverables />
 +
<!-- ============================  -->
 +
<hr>
 +
<section begin=prerequisites />
 +
<b>Prerequisites:</b><br />
 +
You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:<br />
 
*<b>Calculus</b>: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof.
 
*<b>Calculus</b>: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof.
−
<!-- included from "FND-prerequisites.wtxt", section: "geometry" -->
 
 
*<b>Geometry</b>: length, area, volume; Euclidian and non-Euclidian space.
 
*<b>Geometry</b>: length, area, volume; Euclidian and non-Euclidian space.
−
<!-- included from "FND-prerequisites.wtxt", section: "probability" -->
 
 
*<b>Probability</b>: event, probability, hypothesis and significance.
 
*<b>Probability</b>: event, probability, hypothesis and significance.
−
<!-- included from "FND-prerequisites.wtxt", section: "physchem" -->
 
 
*<b>Physical chemistry</b>: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law.
 
*<b>Physical chemistry</b>: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law.
−
<!-- included from "ABC-unit_components.wtxt", section: "notes-prerequisites" -->
+
This unit builds on material covered in the following prerequisite units:<br />
−
You need to complete the following units before beginning this one:
+
*[[BIN-Sequence|BIN-Sequence (Sequence)]]
−
*[[BIN-Sequence]]
+
<section end=prerequisites />
 +
<!-- ============================  -->
 +
</div>
  
−
{{Vspace}}
+
{{Smallvspace}}
  
  
−
=== Objectives ===
 
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "objectives" -->
 
−
...
 
  
−
{{Vspace}}
+
{{Smallvspace}}
  
  
−
=== Outcomes ===
+
__TOC__
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "outcomes" -->
 
−
...
 
−
 
 
−
{{Vspace}}
 
−
 
 
−
 
 
−
=== Deliverables ===
 
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "deliverables" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-time_management" -->
 
−
*<b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-journal" -->
 
−
*<b>Journal</b>: Document your progress in your [[FND-Journal|course journal]].
 
−
<!-- included from "ABC-unit_components.wtxt", section: "deliverables-insights" -->
 
−
*<b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|insights! page]].
 
  
 
{{Vspace}}
 
{{Vspace}}
Line 80: Line 71:
  
 
=== Evaluation ===
 
=== Evaluation ===
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "evaluation" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "eval-none" -->
 
 
<b>Evaluation: NA</b><br />
 
<b>Evaluation: NA</b><br />
−
:This unit is not evaluated for course marks.
+
<div style="margin-left: 2rem;">This unit is not evaluated for course marks.</div>
−
 
 
−
{{Vspace}}
 
−
 
 
−
 
 
−
</div>
 
−
<div id="BIO">
 
 
== Contents ==
 
== Contents ==
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "contents" -->
 
−
...
 
  
−
{{Vspace}}
+
{{Task|1=
 +
* Read the introductory notes on {{ABC-PDF|FND-STA-Information_theory|concepts of Shannon's theory of information}} as applied in bioinformatics.
 +
}}
  
−
 
−
== Further reading, links and resources ==
 
−
<!-- {{#pmid: 19957275}} -->
 
−
<!-- {{WWW|WWW_GMOD}} -->
 
−
<!-- <div class="reference-box">[http://www.ncbi.nlm.nih.gov]</div> -->
 
  
 
{{Vspace}}
 
{{Vspace}}
  
−
 
−
== Notes ==
 
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "notes" -->
 
−
<!-- included from "ABC-unit_components.wtxt", section: "notes" -->
 
−
<references />
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
</div>
 
−
<div id="ABC-unit-framework">
 
−
== Self-evaluation ==
 
−
<!-- included from "../components/FND-Information_theory.components.wtxt", section: "self-evaluation" -->
 
−
<!--
 
−
=== Question 1===
 
−
 
−
Question ...
 
−
 
−
<div class="toccolours mw-collapsible mw-collapsed" style="width:800px">
 
−
Answer ...
 
−
<div class="mw-collapsible-content">
 
−
Answer ...
 
−
 
−
</div>
 
−
  </div>
 
−
 
−
  {{Vspace}}
 
−
 
−
-->
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
 
−
{{Vspace}}
 
−
 
−
 
−
<!-- included from "ABC-unit_components.wtxt", section: "ABC-unit_ask" -->
 
−
 
−
----
 
−
 
−
{{Vspace}}
 
−
 
−
<b>If in doubt, ask!</b> If anything about this learning unit is not clear to you, do not proceed blindly but ask for clarification. Post your question on the course mailing list: others are likely to have similar problems. Or send an email to your instructor.
 
−
 
−
----
 
−
 
−
{{Vspace}}
 
  
 
<div class="about">
 
<div class="about">
Line 161: Line 91:
 
:2017-08-05
 
:2017-08-05
 
<b>Modified:</b><br />
 
<b>Modified:</b><br />
−
:2017-08-05
+
:2020-09-24
 
<b>Version:</b><br />
 
<b>Version:</b><br />
−
:0.1
+
:1.1
 
<b>Version history:</b><br />
 
<b>Version history:</b><br />
 +
*1.1 2020 Maintenance
 +
*1.0 First live version
 
*0.1 First stub
 
*0.1 First stub
 
</div>
 
</div>
−
[[Category:ABC-units]]
 
−
<!-- included from "ABC-unit_components.wtxt", section: "ABC-unit_footer" -->
 
  
 
{{CC-BY}}
 
{{CC-BY}}
  
 +
[[Category:ABC-units]]
 +
{{UNIT}}
 +
{{LIVE}}
 
</div>
 
</div>
 
<!-- [END] -->
 
<!-- [END] -->

Latest revision as of 11:40, 24 September 2020

Concepts of Information Theory

(Information theory)


 


Abstract:

A brief introduction to entropy and information: information theory appled to amino acid disributions.

Objectives:
This unit will ...

  • ... introduce concepts of the foundations of information theory and its application to amino acid distributions.

Outcomes:
After working through this unit you ...

  • ... can calculate the informational entropy in a distribution of observed amino acids;
  • ... are familar with various ways to define the informational entropy of reference distributions;
  • ... can calculate information as the difference between expected and observed entropy.

Deliverables:

  • Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
  • Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don't overlook these.
  • Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.

    • Prerequisites:
    You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:

    • Calculus: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof.
    • Geometry: length, area, volume; Euclidian and non-Euclidian space.
    • Probability: event, probability, hypothesis and significance.
    • Physical chemistry: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law.

    This unit builds on material covered in the following prerequisite units:


     



     



     


    Evaluation

    Evaluation: NA

    This unit is not evaluated for course marks.

    Contents

    Task:


     


    About ...
     
    Author:

    Boris Steipe <boris.steipe@utoronto.ca>

    Created:

    2017-08-05

    Modified:

    2020-09-24

    Version:

    1.1

    Version history:

    • 1.1 2020 Maintenance
    • 1.0 First live version
    • 0.1 First stub

    CreativeCommonsBy.png This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.

    Retrieved from "http://steipe.biochemistry.utoronto.ca/abc/index.php?title=FND-STA-Information_theory&oldid=11634"