Difference between revisions of "FND-STA-Information theory"
Jump to navigation
Jump to search
m |
m |
||
| Line 28: | Line 28: | ||
== Abstract == | == Abstract == | ||
<section begin=abstract /> | <section begin=abstract /> | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "abstract" --> |
A brief introduction to entropy and information: information theory appled to amino acid disributions. | A brief introduction to entropy and information: information theory appled to amino acid disributions. | ||
<section end=abstract /> | <section end=abstract /> | ||
| Line 37: | Line 37: | ||
== This unit ... == | == This unit ... == | ||
=== Prerequisites === | === Prerequisites === | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "prerequisites" --> |
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "notes-external_prerequisites" --> |
You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources: | You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources: | ||
| − | <!-- included from " | + | <!-- included from "./data/ABC-unit_prerequisites.txt", section: "calculus" --> |
*<b>Calculus</b>: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof. | *<b>Calculus</b>: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof. | ||
| − | <!-- included from " | + | <!-- included from "./data/ABC-unit_prerequisites.txt", section: "geometry" --> |
*<b>Geometry</b>: length, area, volume; Euclidian and non-Euclidian space. | *<b>Geometry</b>: length, area, volume; Euclidian and non-Euclidian space. | ||
| − | <!-- included from " | + | <!-- included from "./data/ABC-unit_prerequisites.txt", section: "probability" --> |
*<b>Probability</b>: event, probability, hypothesis and significance. | *<b>Probability</b>: event, probability, hypothesis and significance. | ||
| − | <!-- included from " | + | <!-- included from "./data/ABC-unit_prerequisites.txt", section: "physchem" --> |
*<b>Physical chemistry</b>: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law. | *<b>Physical chemistry</b>: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law. | ||
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "notes-prerequisites" --> |
You need to complete the following units before beginning this one: | You need to complete the following units before beginning this one: | ||
*[[BIN-Sequence|BIN-Sequence (Sequence)]] | *[[BIN-Sequence|BIN-Sequence (Sequence)]] | ||
| Line 56: | Line 56: | ||
=== Objectives === | === Objectives === | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "objectives" --> |
This unit will ... | This unit will ... | ||
* ... introduce concepts of the foundations of information theory and its application to amino acid distributions. | * ... introduce concepts of the foundations of information theory and its application to amino acid distributions. | ||
| Line 64: | Line 64: | ||
=== Outcomes === | === Outcomes === | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "outcomes" --> |
After working through this unit you ... | After working through this unit you ... | ||
* ... can calculate the informational entropy in a distribution of observed amino acids; | * ... can calculate the informational entropy in a distribution of observed amino acids; | ||
| Line 74: | Line 74: | ||
=== Deliverables === | === Deliverables === | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "deliverables" --> |
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "deliverables-time_management" --> |
*<b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit. | *<b>Time management</b>: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit. | ||
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "deliverables-journal" --> |
*<b>Journal</b>: Document your progress in your [[FND-Journal|Course Journal]]. Some tasks may ask you to include specific items in your journal. Don't overlook these. | *<b>Journal</b>: Document your progress in your [[FND-Journal|Course Journal]]. Some tasks may ask you to include specific items in your journal. Don't overlook these. | ||
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "deliverables-insights" --> |
*<b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|'''insights!''' page]]. | *<b>Insights</b>: If you find something particularly noteworthy about this unit, make a note in your [[ABC-Insights|'''insights!''' page]]. | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
{{Vspace}} | {{Vspace}} | ||
| Line 97: | Line 88: | ||
<div id="BIO"> | <div id="BIO"> | ||
== Contents == | == Contents == | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "contents" --> |
{{Task|1= | {{Task|1= | ||
| Line 116: | Line 107: | ||
== Notes == | == Notes == | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "notes" --> |
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "notes" --> |
<references /> | <references /> | ||
| Line 126: | Line 117: | ||
<div id="ABC-unit-framework"> | <div id="ABC-unit-framework"> | ||
== Self-evaluation == | == Self-evaluation == | ||
| − | <!-- included from " | + | <!-- included from "./components/FND-STA-Information_theory.components.txt", section: "self-evaluation" --> |
<!-- | <!-- | ||
=== Question 1=== | === Question 1=== | ||
| Line 151: | Line 142: | ||
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "ABC-unit_ask" --> |
---- | ---- | ||
| Line 179: | Line 170: | ||
</div> | </div> | ||
[[Category:ABC-units]] | [[Category:ABC-units]] | ||
| − | <!-- included from "ABC-unit_components. | + | <!-- included from "./data/ABC-unit_components.txt", section: "ABC-unit_footer" --> |
{{CC-BY}} | {{CC-BY}} | ||
Revision as of 01:26, 6 January 2018
Concepts of Information Theory
Keywords: Information theory
Contents
Abstract
A brief introduction to entropy and information: information theory appled to amino acid disributions.
This unit ...
Prerequisites
You need the following preparation before beginning this unit. If you are not familiar with this material from courses you took previously, you need to prepare yourself from other information sources:
- Calculus: functions and equations; polynomial functions, logarithms, trigonometric functions; integrals and derivatives; theorem and proof.
- Geometry: length, area, volume; Euclidian and non-Euclidian space.
- Probability: event, probability, hypothesis and significance.
- Physical chemistry: Kinetics and equilibria, transition states, chemical reactions; enthalpy, entropy and free energy; acid-base equilibria, Boltzmann's law.
You need to complete the following units before beginning this one:
Objectives
This unit will ...
- ... introduce concepts of the foundations of information theory and its application to amino acid distributions.
Outcomes
After working through this unit you ...
- ... can calculate the informational entropy in a distribution of observed amino acids;
- ... are familar with various ways to define the informational entropy of reference distributions;
- ... can calculate information as the difference between expected and observed entropy.
Deliverables
- Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
- Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don't overlook these.
- Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.
Contents
Task:
- Read the introductory notes on concepts of Shannon's theory of information as applied in bioinformatics.
Further reading, links and resources
Notes
Self-evaluation
If in doubt, ask! If anything about this learning unit is not clear to you, do not proceed blindly but ask for clarification. Post your question on the course mailing list: others are likely to have similar problems. Or send an email to your instructor.
About ...
Author:
- Boris Steipe <boris.steipe@utoronto.ca>
Created:
- 2017-08-05
Modified:
- 2017-10-23
Version:
- 1.0
Version history:
- 1.0 First live version
- 0.1 First stub
This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.
