Difference between revisions of "BIN-NCBI"
m |
m |
||
(4 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
<div id="ABC"> | <div id="ABC"> | ||
− | <div style="padding:5px; border: | + | <div style="padding:5px; border:4px solid #000000; background-color:#b3dbce; font-size:300%; font-weight:400; color: #000000; width:100%;"> |
The NCBI Database and Services | The NCBI Database and Services | ||
− | <div style="padding:5px; margin-top:20px; margin-bottom:10px; background-color:# | + | <div style="padding:5px; margin-top:20px; margin-bottom:10px; background-color:#b3dbce; font-size:30%; font-weight:200; color: #000000; "> |
(The NCBI databases and services) | (The NCBI databases and services) | ||
</div> | </div> | ||
Line 10: | Line 10: | ||
− | <div style="padding:5px; border:1px solid #000000; background-color:# | + | <div style="padding:5px; border:1px solid #000000; background-color:#b3dbce33; font-size:85%;"> |
<div style="font-size:118%;"> | <div style="font-size:118%;"> | ||
<b>Abstract:</b><br /> | <b>Abstract:</b><br /> | ||
Line 58: | Line 58: | ||
− | |||
{{Smallvspace}} | {{Smallvspace}} | ||
Line 74: | Line 73: | ||
<li>Create a new page on the student Wiki as a subpage of your User Page.</li> | <li>Create a new page on the student Wiki as a subpage of your User Page.</li> | ||
<li>Put all of your writing to submit on this one page.</li> | <li>Put all of your writing to submit on this one page.</li> | ||
− | <li>When you are done with everything, go to the [https://q.utoronto.ca/courses/180416/assignments | + | <li>When you are done with everything, go to the [https://q.utoronto.ca/courses/180416/assignments Quercus '''Assignments''' page] and open the first Learning Unit that you have not submitted yet. Paste the URL of your Wiki page into the form, and click on '''Submit Assignment'''.</li> |
+ | </ol> | ||
− | + | Your link can be submitted only once and not edited. But you may change your Wiki page at any time. However only the last version before the due date will be marked. All later edits will be silently ignored. | |
<div class = "note">You can only submit either this unit or the [[BIN-EBI|EBI Learning unit]] for marking, not both. | <div class = "note">You can only submit either this unit or the [[BIN-EBI|EBI Learning unit]] for marking, not both. | ||
</div> | </div> | ||
+ | |||
+ | {{Smallvspace}} | ||
; Short Report option | ; Short Report option | ||
Line 85: | Line 87: | ||
:#Create a new page on the student Wiki as a subpage of your User Page. | :#Create a new page on the student Wiki as a subpage of your User Page. | ||
:#Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to [[ABC-Rubrics|the '''"General" section of the marking rubrics''']] for aspects of the report that will be evaluated. | :#Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to [[ABC-Rubrics|the '''"General" section of the marking rubrics''']] for aspects of the report that will be evaluated. | ||
− | :# | + | :# Submit the page via Quercus as described above.. |
− | |||
− | |||
− | |||
− | |||
<!-- | <!-- | ||
Line 98: | Line 96: | ||
--> | --> | ||
+ | <!-- | ||
; Quiz option | ; Quiz option | ||
: Open the [http://steipe.biochemistry.utoronto.ca/abc/students/index.php/Signup-BIN-NCBI_Quiz '''signup-page for the quiz for this unit (linked from here)'''] and add your name. Your name must be signed up by 12:00 of the day of the Quiz to ensure copies of the quiz are available for all participants. | : Open the [http://steipe.biochemistry.utoronto.ca/abc/students/index.php/Signup-BIN-NCBI_Quiz '''signup-page for the quiz for this unit (linked from here)'''] and add your name. Your name must be signed up by 12:00 of the day of the Quiz to ensure copies of the quiz are available for all participants. | ||
<div style="margin-left: 2rem;">Quizzes will be written in class, back-to-back if there is more than one quiz scheduled. We may begin at any time. We will have an open-ended Q&A session before the quiz. You can't take the quiz if you are not present in class when the question sheets are handed out, so don't be late. Once all scheduled quizzes are written, we will discuss and mark them. You will mark your own quiz. All marking must be done with a red pen - so you '''must''' bring a red pen to class in order to participate. The mark you give yourself may be revised by the instructor after spot-checking quizzes. If this is necessary, you will be notified. You must mark your quiz correctly and honestly - don't get into trouble with academic integrity rules: it will be an academic offence if you mark questions as correct that were discussed in class and should have been marked incorrect. When in doubt, ask.</div> | <div style="margin-left: 2rem;">Quizzes will be written in class, back-to-back if there is more than one quiz scheduled. We may begin at any time. We will have an open-ended Q&A session before the quiz. You can't take the quiz if you are not present in class when the question sheets are handed out, so don't be late. Once all scheduled quizzes are written, we will discuss and mark them. You will mark your own quiz. All marking must be done with a red pen - so you '''must''' bring a red pen to class in order to participate. The mark you give yourself may be revised by the instructor after spot-checking quizzes. If this is necessary, you will be notified. You must mark your quiz correctly and honestly - don't get into trouble with academic integrity rules: it will be an academic offence if you mark questions as correct that were discussed in class and should have been marked incorrect. When in doubt, ask.</div> | ||
+ | --> | ||
<!-- | <!-- | ||
Line 107: | Line 107: | ||
--> | --> | ||
− | ; Option to write a "Self-Evaluation Question" | + | ;Option to write a "Self-Evaluation Question" |
+ | : You can submit a "Self-Evaluation Question" for at most '''one''' of your assignments. | ||
: Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing '''valuable''' knowledge and skills, not Cargo Cult. Apply the [[ABC-Rubrics| '''marking rubrics''']] in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the [[Self_evaluation_questions|'''Self evaluation questions page''']] - but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high. | : Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing '''valuable''' knowledge and skills, not Cargo Cult. Apply the [[ABC-Rubrics| '''marking rubrics''']] in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the [[Self_evaluation_questions|'''Self evaluation questions page''']] - but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high. | ||
:# Create a new page on the student Wiki as a subpage of your User Page. Develop your question there. | :# Create a new page on the student Wiki as a subpage of your User Page. Develop your question there. | ||
Line 145: | Line 146: | ||
− | The result page of your search in "All Databases" is the "Global Query Result Page" of the Entrez system. If you follow the "Protein" link, you get taken to the more than | + | The result page of your search in "All Databases" is the "Global Query Result Page" of the Entrez system. If you follow the "Protein" link, you get taken to the more than 4,000 sequences in the NCBI Protein database that contain the keyword "mbp1". But when you look more closely at the results, you see that the result is quite non-specific: searching only by keyword retrieves a multiubiquitin chain binding protein in ''Arabidopsis'', myrosinase binding proteins, bacterial mannose binding proteins, a ''Saccharomyces'' protein (perhaps one that we are actually interested in), maltose binding proteins, myelin basic proteins - and much more. There must be a more specific way to search, and indeed there is. Time to read up on the Entrez system. |
Line 189: | Line 190: | ||
− | This finds | + | This finds three entries in the Protein database. Follow the link to the result <code>CAA98618.1</code>—a data record in Genbank Flat File (GFF) format<ref>If there is only a single match, you will be been taken directly to the page.</ref>. The database identifier <code>CAA98618.1</code> tells you that this is a record in the GenPept database. There are actually several, identical versions of this sequence in the NCBI's holdings. A link to the [https://www.ncbi.nlm.nih.gov/ipg/258763 "Identical Protein Groups" Database] near the top of the record shows you what these are: |
Line 260: | Line 261: | ||
====Digression: A "bookmarklet" to access literature==== | ====Digression: A "bookmarklet" to access literature==== | ||
− | PubMed usually includes links to full-text articles, but these are often behind a paywall, even though we have access through our library system (one of the top three in the world incidentally). Here is a bookmarklet (a portmanteau of "bookmark" and "applet") to seamlessly redirect from a paywall page to full access | + | PubMed usually includes links to full-text articles, but these are often behind a paywall, even though we have access through our library system (one of the top three in the world incidentally). Here is a bookmarklet (a portmanteau of "bookmark" and "applet") to seamlessly redirect from a paywall page to full access through our library's "my access" system. The key is to apply a bit of code that "rewrites" the original URL. |
* In your browser, create a bookmark to anything, call it "MyAccess"", and put it into your bookmarks bar for convenience. Then edit it: replace the URL of the bookmark with the following snip of Javascript: | * In your browser, create a bookmark to anything, call it "MyAccess"", and put it into your bookmarks bar for convenience. Then edit it: replace the URL of the bookmark with the following snip of Javascript: | ||
Line 288: | Line 289: | ||
{{Vspace}} | {{Vspace}} | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
== Notes == | == Notes == | ||
<references /> | <references /> | ||
Line 323: | Line 303: | ||
:2017-08-05 | :2017-08-05 | ||
<b>Modified:</b><br /> | <b>Modified:</b><br /> | ||
− | :2020- | + | :2020-10-07 |
<b>Version:</b><br /> | <b>Version:</b><br /> | ||
− | :1. | + | :1.2 |
<b>Version history:</b><br /> | <b>Version history:</b><br /> | ||
+ | *1.2 Edit policy update | ||
*1.1 2020 updates and revised marking | *1.1 2020 updates and revised marking | ||
*1.0.1 Removed NCBI linkrot | *1.0.1 Removed NCBI linkrot | ||
Line 336: | Line 317: | ||
[[Category:ABC-units]] | [[Category:ABC-units]] | ||
+ | {{EVAL}} | ||
+ | {{LIVE}} | ||
+ | {{EVAL}} | ||
</div> | </div> | ||
<!-- [END] --> | <!-- [END] --> |
Latest revision as of 05:01, 10 October 2020
The NCBI Database and Services
(The NCBI databases and services)
Abstract:
The NCBI hosts some of the world's most important bioinformatics databases and services. This learning unit explores them in the context of our search for information on yeast Mbp1 and its homologue in MYSPE.
Objectives:
|
Outcomes:
|
Deliverables:
Prerequisites:
This unit builds on material covered in the following prerequisite units:
Contents
Evaluation
This learning unit can be evaluated for a maximum of 5 marks. There are several options for submission. Choose one option, then ...
- Create a new page on the student Wiki as a subpage of your User Page.
- Put all of your writing to submit on this one page.
- When you are done with everything, go to the Quercus Assignments page and open the first Learning Unit that you have not submitted yet. Paste the URL of your Wiki page into the form, and click on Submit Assignment.
Your link can be submitted only once and not edited. But you may change your Wiki page at any time. However only the last version before the due date will be marked. All later edits will be silently ignored.
- Short Report option
- In the BIN-Storing_data unit you have found the protein of MYSPE that is most similar to yeast Mbp1, in MYSPE. Navigate to the NCBI Protein page for the RefSeq entry of this protein. Explore the links that go out from the page. For three linked resources, describe a plausible scenario how it would be used to answer a research question in a laboratory.
- Create a new page on the student Wiki as a subpage of your User Page.
- Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to the "General" section of the marking rubrics for aspects of the report that will be evaluated.
- Submit the page via Quercus as described above..
- Option to write a "Self-Evaluation Question"
- You can submit a "Self-Evaluation Question" for at most one of your assignments.
- Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing valuable knowledge and skills, not Cargo Cult. Apply the marking rubrics in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the Self evaluation questions page - but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high.
- Create a new page on the student Wiki as a subpage of your User Page. Develop your question there.
- Submit the page via Quercus as described above.
Contents
The NCBI (National Center for Biotechnology Information) is one of the two largest, international providers of data for genomics and molecular biology (the EBI is the other). With its annual budget of several hundred million dollars, it organizes a challenging program of data management at the largest scale, it makes its data freely and openly available over the Internet, worldwide, and it runs significant in-house research projects.
In this unit we explore some of the offerings of the NCBI that can contribute to our objective of studying a particular gene in an organism of interest.
Task:
- Read the introductory article on NCBI database resources:
Sayers et al. (2020) Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 48:D9-D16. (pmid: 31602479) |
[ PubMed ] [ DOI ] The National Center for Biotechnology Information (NCBI) provides a large suite of online resources for biological information and data, including the GenBank® nucleic acid sequence database and the PubMed database of citations and abstracts published in life science journals. The Entrez system provides search and retrieval operations for most of these data from 35 distinct databases. The E-utilities serve as the programming interface for the Entrez system. Custom implementations of the BLAST program provide sequence-based searching of many specialized datasets. New resources released in the past year include a new PubMed interface, a sequence database search and a gene orthologs page. Additional resources that were updated in the past year include PMC, Bookshelf, My Bibliography, Assembly, RefSeq, viral genomes, the prokaryotic genome annotation pipeline, Genome Workbench, dbSNP, BLAST, Primer-BLAST, IgBLAST and PubChem. All of these resources can be accessed through the NCBI home page at www.ncbi.nlm.nih.gov. |
Entrez
Task:
Remember to document your activities as lab-notes on your Wiki.
- Access the NCBI website at http://www.ncbi.nlm.nih.gov/ [1]
- In the search bar, enter
mbp1
and click Search. - On the resulting page, look for the Protein section and click on the link. What do you find?
The result page of your search in "All Databases" is the "Global Query Result Page" of the Entrez system. If you follow the "Protein" link, you get taken to the more than 4,000 sequences in the NCBI Protein database that contain the keyword "mbp1". But when you look more closely at the results, you see that the result is quite non-specific: searching only by keyword retrieves a multiubiquitin chain binding protein in Arabidopsis, myrosinase binding proteins, bacterial mannose binding proteins, a Saccharomyces protein (perhaps one that we are actually interested in), maltose binding proteins, myelin basic proteins - and much more. There must be a more specific way to search, and indeed there is. Time to read up on the Entrez system.
Task:
- Navigate to the Entrez Help Page and read about the Entrez system, especially about:
- Boolean operators,
- wildcards,
- limits, and
- filters.
- You should minimally understand:
- How to search by keyword;
- How to search by gene or protein name;
- How to restrict a search to a particular organism.
And you should know that these filters are in part database specific, i.e. not all of them will work in all databases.
Don't skip this part, you should know the more common options and how to find the others. It would be great to have a synopsis of the important fields for reference, wouldn't it? We have started building one on the Student Wiki (A synopsis of Entrez codes). Currently, I think it lacks structure, and examples. Contributors and editors welcome!
Keyword and organism searches are pretty universal, but apart from that, each NCBI database has its own set of specific fields. You can access the keywords via the Advanced Search interface of any of the database pages.
Protein Sequence
Task:
With this knowledge we can restrict the search to proteins called "Mbp1" that occur in Baker's Yeast. Return to the Global Search page and in the search field, type:
Mbp1[protein name] AND
"Saccharomyces cerevisiae"[organism]
This finds three entries in the Protein database. Follow the link to the result CAA98618.1
—a data record in Genbank Flat File (GFF) format[2]. The database identifier CAA98618.1
tells you that this is a record in the GenPept database. There are actually several, identical versions of this sequence in the NCBI's holdings. A link to the "Identical Protein Groups" Database near the top of the record shows you what these are:
Some of the sequences represent duplicate entries of the same gene (Mbp1) in the same strain (S288c) of the same species (S. cerevisiae). In particular:
- there are several records for which the source is the INSDC, these are archival entries, submitted by independent yeast genome research projects;
- there are two entries in the RefSeq database linking to the same protein:
NP_010227.1
. One is derived from genome sequence, the other from mRNA. This RefSeq entry is the preferred version of a sequence for our purposes. RefSeq is a curated, non-redundant database which solves a number of problems of archival databases. You can recognize RefSeq identifiers – they always look like NP_12345.1, NM_12345.1, XP_12345.1, NC_12345.1 etc. This reflects whether the sequence is protein, mRNA or genomic, and inferred or obtained through experimental evidence.
- there is a SwissProt sequence
P39678.1
[3]. This link is kind of a big deal. It's a cross-reference into UniProt, the huge protein sequence database maintained by the EBI (European Bioinformatics Institute), which is the NCBI's counterpart in Europe. SwissProt entries have the highest annotation standard overall and are expertly curated. Many Webservices work with UniProt ID's (e.g.P39678.1
), rather than NCBI IDs such as a RefSeq ID. But it used to be until recently that the two databases did not link to each other, mostly for reasons of funding politics. It's great to see that this divide has now been overcome.
- Note that while all of these entries come from Saccharomyces cerevisiae, they have been sequenced in different yeast strains. Thus they don't have to be identical (except for the fact that this is a table of identical sequences), such related sequences might be slightly different because the strains are after all not genetically identical. And sometimes we find identical sequences in quite divergent species. Therefore I would not actually consider
EIW11153.1
,AJU86440.1
,AJU58508.1
, andAJU61971.1
to be identical proteins, although they have the same sequence.
Note all the .1
suffixes of the sequence identifiers. These are version numbers. Two observations:
- It's great that version numbers are now used throughout the NCBI database. This is good database engineering practice because it's really important for reproducible research that updates to database records are possible, but recognizable. When working with data you always must provide for the possibility of updates, and manage the changes transparently and explicitly. Proper versioning should be a part of all datamodels. In fact, the NCBI has recently phased out its internal unique identifiers – the GI number – in favour of accession-number.version IDs everywhere.
- When searching, or for general use, you can (and should) omit the version number, i.e. use
NP_010227
orP39678
notNP_010227.1
resp.P39678.1
. This way the database system will resolve the identifier to the most current, highest version number (unless you want the older one, of course).
Task:
- Note down the RefSeq ID and the UniProt (SwissProt) ID of Mbp1 in your journal.
- Follow the link to the RefSeq entry
NP_010227.1
. - Explore the page and explore these links (note the contents in your journal):
- Under "Analyze this Sequence": Identify Conserved Domains
- Under "Protein 3D Structure": See all 3 structures...
- Under "Pathways for the MBP1 gene": Cell cycle - yeast
- Under "Related information" Proteins with Similar Sequence
As we see, this is a good start page to explore all kinds of databases at the NCBI via cross-references.
PubMed
Arguably one of the most important databases in the life sciences is PubMed and this is a good time to look at PubMed in a bit more detail.
Task:
- Return back to the MBP1 RefSeq record.
- Find the PubMed link under Related information in the right-hand margin and explore it. This are links that are directly related to the NP_010227 sequence in the database.
- Next follow the link to "PubMed (Weighted)" which applies a weighting algorithm to find broadly relevant information - an example of literature data mining. PubMed(weighted) appears to give a pretty good overview of systems-biology type, cross-sectional and functional information.
But it does not find all Mbp1 related literature.
- On any of the PubMed pages open the Advanced query page and study the keywords that apply to PubMed searches. These are actually quite important and useful to remember. Make yourself familiar with the section on Search field descriptions and tags in the PubMed help document, (in particular [DP], [AU], [TI], and [TA]), how you use the History to combine searches, and the use of AND, OR, NOT and brackets. Understand how you can restrict a search to reviews only, and what the link to Related citations... is useful for[4].
- Now find publications from anywhere in PubMed with Mbp1 in the title. In the result list, follow the links for the two Biochemistry papers, by Taylor et al. (2000) and by Deleeuw et al. (2008). Download the PDFs, these manuscripts will be needed in a later unit.
Digression: A "bookmarklet" to access literature
PubMed usually includes links to full-text articles, but these are often behind a paywall, even though we have access through our library system (one of the top three in the world incidentally). Here is a bookmarklet (a portmanteau of "bookmark" and "applet") to seamlessly redirect from a paywall page to full access through our library's "my access" system. The key is to apply a bit of code that "rewrites" the original URL.
- In your browser, create a bookmark to anything, call it "MyAccess"", and put it into your bookmarks bar for convenience. Then edit it: replace the URL of the bookmark with the following snip of Javascript:
javascript:(function(){var url=window.location.href;var re=/\/([\w.]+)\/(.*$)/;var match=url.match(re);var newURL="http://"+match[1]+".myaccess.library.utoronto.ca/"+match[2];window.location.href=newURL;})();void 0
No line breaks!
Then try it. Go to the following article from outside the university network ...
http://science.sciencemag.org/content/303/5659/788.long
... you should see the abstract but you can't view the full text without being an AAAS member. Then click on your bookmarklet. It should automatically rewrite the URL, take you to the UofT login screen, and take you to a page with full access to the article.
I hope you find this as useful as I do. The strategy lends itself to other nice ideas.
Original Information and Annotation Transfer
Task:
In the BIN-Storing_data unit you have found the protein of MYSPE that is most similar to yeast Mbp1, in MYSPE. Navigate to the NCBI Protein page for the RefSeq entry of this protein. Explore the links that go out from the page. Assess which resources are independently useful, and which resources merely recapitulate information that relates to yeast Mbp1, the protein that you originally searched with. The goal is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer.
Notes
- ↑ If you find this URL hard to remember, consider the acronyms:
- ncbi.nlm.nih.gov
- NCBI: National Center for Biotechnology Information
- NLM: National Library of Medicine
- NIH: National Institutes of Health
- GOV: the US GOVernment top-level domain
- ↑ If there is only a single match, you will be been taken directly to the page.
- ↑ Actually the "real" SwissProt identifier would be patterned like
MBP1_YEAST
.P39678
is the corresponding UniProt identifier. - ↑ A good way to consolidate your knowledge is to summarize it for everyone on the Entrez page of the Student Wiki, or enhance the information you find there.
About ...
Author:
- Boris Steipe <boris.steipe@utoronto.ca>
Created:
- 2017-08-05
Modified:
- 2020-10-07
Version:
- 1.2
Version history:
- 1.2 Edit policy update
- 1.1 2020 updates and revised marking
- 1.0.1 Removed NCBI linkrot
- 1.0 First live version
- 0.1 First stub
This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.