Difference between revisions of "BIN-NCBI"

From "A B C"
Jump to navigation Jump to search
m
m
 
(3 intermediate revisions by the same user not shown)
Line 73: Line 73:
 
<li>Create a new page on the student Wiki as a subpage of your User Page.</li>
 
<li>Create a new page on the student Wiki as a subpage of your User Page.</li>
 
<li>Put all of your writing to submit on this one page.</li>
 
<li>Put all of your writing to submit on this one page.</li>
<li>When you are done with everything, go to the [https://q.utoronto.ca/courses/180416/assignments Qercus '''Assignments''' page] and open the first Learning Unit that you have not submitted yet. Paste the URL of your Wiki page into the form, and click on '''Submit Assignment'''.</li>
+
<li>When you are done with everything, go to the [https://q.utoronto.ca/courses/180416/assignments Quercus '''Assignments''' page] and open the first Learning Unit that you have not submitted yet. Paste the URL of your Wiki page into the form, and click on '''Submit Assignment'''.</li>
 +
</ol>
  
'''Do not''' change your Wiki page after you have submitted your assignment, until it has been graded.
+
Your link can be submitted only once and not edited. But you may change your Wiki page at any time. However only the last version before the due date will be marked. All later edits will be silently ignored.
  
 
<div class = "note">You can only submit either this unit or the [[BIN-EBI|EBI Learning unit]] for marking, not both.
 
<div class = "note">You can only submit either this unit or the [[BIN-EBI|EBI Learning unit]] for marking, not both.
 
</div>
 
</div>
 +
 +
{{Smallvspace}}
  
 
; Short Report option
 
; Short Report option
Line 84: Line 87:
 
:#Create a new page on the student Wiki as a subpage of your User Page.
 
:#Create a new page on the student Wiki as a subpage of your User Page.
 
:#Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to [[ABC-Rubrics|the '''"General" section of the marking rubrics''']] for aspects of the report that will be evaluated.
 
:#Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to [[ABC-Rubrics|the '''"General" section of the marking rubrics''']] for aspects of the report that will be evaluated.
:# When you are done with everything, add the following category tag '''to the end of page''':
+
:# Submit the page via Quercus as described above..
::<code><nowiki>[[Category:EVAL-BIN-NCBI]]</nowiki></code>.
 
 
 
Once the page has been saved with this tag, it is considered "submitted".
 
'''Do not''' change your submission after this tag has been added. The page will be marked and the category tag will be removed by the instructor.
 
  
 
<!--
 
<!--
Line 108: Line 107:
 
-->
 
-->
  
; Option to write a "Self-Evaluation Question"
+
;Option to write a "Self-Evaluation Question"
 +
: You can submit  a "Self-Evaluation Question" for at most '''one''' of your  assignments.
 
: Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing '''valuable''' knowledge and skills, not Cargo Cult. Apply the [[ABC-Rubrics| '''marking rubrics''']] in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the [[Self_evaluation_questions|'''Self evaluation questions page''']] -  but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high.
 
: Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing '''valuable''' knowledge and skills, not Cargo Cult. Apply the [[ABC-Rubrics| '''marking rubrics''']] in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the [[Self_evaluation_questions|'''Self evaluation questions page''']] -  but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high.
 
:# Create a new page on the student Wiki as a subpage of your User Page. Develop your question there.
 
:# Create a new page on the student Wiki as a subpage of your User Page. Develop your question there.
Line 303: Line 303:
 
:2017-08-05
 
:2017-08-05
 
<b>Modified:</b><br />
 
<b>Modified:</b><br />
:2020-09-20
+
:2020-10-07
 
<b>Version:</b><br />
 
<b>Version:</b><br />
:1.1
+
:1.2
 
<b>Version history:</b><br />
 
<b>Version history:</b><br />
 +
*1.2 Edit policy update
 
*1.1 2020 updates and revised marking
 
*1.1 2020 updates and revised marking
 
*1.0.1 Removed NCBI linkrot
 
*1.0.1 Removed NCBI linkrot
Line 316: Line 317:
  
 
[[Category:ABC-units]]
 
[[Category:ABC-units]]
 +
{{EVAL}}
 +
{{LIVE}}
 +
{{EVAL}}
 
</div>
 
</div>
 
<!-- [END] -->
 
<!-- [END] -->

Latest revision as of 05:01, 10 October 2020

The NCBI Database and Services

(The NCBI databases and services)


 


Abstract:

The NCBI hosts some of the world's most important bioinformatics databases and services. This learning unit explores them in the context of our search for information on yeast Mbp1 and its homologue in MYSPE.


Objectives:
This unit will ...

  • ... introduce the Entrez system of NCBI databases and its associated services;
  • ... demonstrate how to navigate from a generic search to a specific record in the RefSeq Protein database and what information is linked from there;
  • ... teach Entrez field codes and qualifiers for searches.

Outcomes:
After working through this unit you ...

  • ... can find the RefSeq Protein record for the Mbp1 homologue in MYSPE;
  • ... are familar with the NCBI databases, and how Entrez cross-references them;
  • ... can confidently apply the correct field codes to search for specific entries.

Deliverables:

  • Time management: Before you begin, estimate how long it will take you to complete this unit. Then, record in your course journal: the number of hours you estimated, the number of hours you worked on the unit, and the amount of time that passed between start and completion of this unit.
  • Journal: Document your progress in your Course Journal. Some tasks may ask you to include specific items in your journal. Don't overlook these.
  • Insights: If you find something particularly noteworthy about this unit, make a note in your insights! page.

  • Prerequisites:
    This unit builds on material covered in the following prerequisite units:


     



     



     


    Evaluation

    This learning unit can be evaluated for a maximum of 5 marks. There are several options for submission. Choose one option, then ...

    1. Create a new page on the student Wiki as a subpage of your User Page.
    2. Put all of your writing to submit on this one page.
    3. When you are done with everything, go to the Quercus Assignments page and open the first Learning Unit that you have not submitted yet. Paste the URL of your Wiki page into the form, and click on Submit Assignment.

    Your link can be submitted only once and not edited. But you may change your Wiki page at any time. However only the last version before the due date will be marked. All later edits will be silently ignored.

    You can only submit either this unit or the EBI Learning unit for marking, not both.


     
    Short Report option
    In the BIN-Storing_data unit you have found the protein of MYSPE that is most similar to yeast Mbp1, in MYSPE. Navigate to the NCBI Protein page for the RefSeq entry of this protein. Explore the links that go out from the page. For three linked resources, describe a plausible scenario how it would be used to answer a research question in a laboratory.
    1. Create a new page on the student Wiki as a subpage of your User Page.
    2. Write a short report on your findings. The goal of this short report is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer. Refer to the "General" section of the marking rubrics for aspects of the report that will be evaluated.
    3. Submit the page via Quercus as described above..



    Option to write a "Self-Evaluation Question"
    You can submit a "Self-Evaluation Question" for at most one of your assignments.
    Write a "Self-evaluation Question" (with a model solution) that explores a significant, non-trivial aspect of studying how to work with NCBI resources within this learning unit. Ensure that the question is feasible, given the existing content of the unit - or coordinate an extension of the contents with your instructor. Ensure your question pursues a high-level learning goal, it should allow others to demonstrate understanding, critical analysis, and/or the capacity to integrate and synthesize knowledge, not merely test memorization. Ensure that your question is specific, not ambiguous, vague or tangential to the contents. Ensure you are testing valuable knowledge and skills, not Cargo Cult. Apply the marking rubrics in spirit to satisfy yourself of the quality of your contribution. Obviously, details of evaluation will vary with the question. Use the format and code templates that you find on the Self evaluation questions page - but don't assume those examples are already models of excellent contributions. Note: assume that approximately the same amount of work is expected for all evaluation options. Consequently, the standard to achieve an excellent mark for this option will be high.
    1. Create a new page on the student Wiki as a subpage of your User Page. Develop your question there.
    2. Submit the page via Quercus as described above.

    Contents

    The NCBI (National Center for Biotechnology Information) is one of the two largest, international providers of data for genomics and molecular biology (the EBI is the other). With its annual budget of several hundred million dollars, it organizes a challenging program of data management at the largest scale, it makes its data freely and openly available over the Internet, worldwide, and it runs significant in-house research projects.

    In this unit we explore some of the offerings of the NCBI that can contribute to our objective of studying a particular gene in an organism of interest.


    Task:

    • Read the introductory article on NCBI database resources:
    Sayers et al. (2020) Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 48:D9-D16. (pmid: 31602479)

    PubMed ] [ DOI ] The National Center for Biotechnology Information (NCBI) provides a large suite of online resources for biological information and data, including the GenBank® nucleic acid sequence database and the PubMed database of citations and abstracts published in life science journals. The Entrez system provides search and retrieval operations for most of these data from 35 distinct databases. The E-utilities serve as the programming interface for the Entrez system. Custom implementations of the BLAST program provide sequence-based searching of many specialized datasets. New resources released in the past year include a new PubMed interface, a sequence database search and a gene orthologs page. Additional resources that were updated in the past year include PMC, Bookshelf, My Bibliography, Assembly, RefSeq, viral genomes, the prokaryotic genome annotation pipeline, Genome Workbench, dbSNP, BLAST, Primer-BLAST, IgBLAST and PubChem. All of these resources can be accessed through the NCBI home page at www.ncbi.nlm.nih.gov.


     

    Entrez

    Task:
    Remember to document your activities as lab-notes on your Wiki.

    1. Access the NCBI website at http://www.ncbi.nlm.nih.gov/ [1]
    2. In the search bar, enter mbp1 and click Search.
    3. On the resulting page, look for the Protein section and click on the link. What do you find?


    The result page of your search in "All Databases" is the "Global Query Result Page" of the Entrez system. If you follow the "Protein" link, you get taken to the more than 4,000 sequences in the NCBI Protein database that contain the keyword "mbp1". But when you look more closely at the results, you see that the result is quite non-specific: searching only by keyword retrieves a multiubiquitin chain binding protein in Arabidopsis, myrosinase binding proteins, bacterial mannose binding proteins, a Saccharomyces protein (perhaps one that we are actually interested in), maltose binding proteins, myelin basic proteins - and much more. There must be a more specific way to search, and indeed there is. Time to read up on the Entrez system.


    Task:

    1. Navigate to the Entrez Help Page and read about the Entrez system, especially about:
      1. Boolean operators,
      2. wildcards,
      3. limits, and
      4. filters.
    2. You should minimally understand:
      1. How to search by keyword;
      2. How to search by gene or protein name;
      3. How to restrict a search to a particular organism.

    And you should know that these filters are in part database specific, i.e. not all of them will work in all databases.

    Don't skip this part, you should know the more common options and how to find the others. It would be great to have a synopsis of the important fields for reference, wouldn't it? We have started building one on the Student Wiki (A synopsis of Entrez codes). Currently, I think it lacks structure, and examples. Contributors and editors welcome!


    Keyword and organism searches are pretty universal, but apart from that, each NCBI database has its own set of specific fields. You can access the keywords via the Advanced Search interface of any of the database pages.


     

    Protein Sequence


     

    Task:
    With this knowledge we can restrict the search to proteins called "Mbp1" that occur in Baker's Yeast. Return to the Global Search page and in the search field, type:

    Mbp1[protein name] AND
    "Saccharomyces cerevisiae"[organism]


    This finds three entries in the Protein database. Follow the link to the result CAA98618.1—a data record in Genbank Flat File (GFF) format[2]. The database identifier CAA98618.1 tells you that this is a record in the GenPept database. There are actually several, identical versions of this sequence in the NCBI's holdings. A link to the "Identical Protein Groups" Database near the top of the record shows you what these are:


    Some of the sequences represent duplicate entries of the same gene (Mbp1) in the same strain (S288c) of the same species (S. cerevisiae). In particular:


    • there are several records for which the source is the INSDC, these are archival entries, submitted by independent yeast genome research projects;
    • there are two entries in the RefSeq database linking to the same protein: NP_010227.1. One is derived from genome sequence, the other from mRNA. This RefSeq entry is the preferred version of a sequence for our purposes. RefSeq is a curated, non-redundant database which solves a number of problems of archival databases. You can recognize RefSeq identifiers – they always look like NP_12345.1, NM_12345.1, XP_12345.1, NC_12345.1 etc. This reflects whether the sequence is protein, mRNA or genomic, and inferred or obtained through experimental evidence.
    • there is a SwissProt sequence P39678.1[3]. This link is kind of a big deal. It's a cross-reference into UniProt, the huge protein sequence database maintained by the EBI (European Bioinformatics Institute), which is the NCBI's counterpart in Europe. SwissProt entries have the highest annotation standard overall and are expertly curated. Many Webservices work with UniProt ID's (e.g. P39678.1), rather than NCBI IDs such as a RefSeq ID. But it used to be until recently that the two databases did not link to each other, mostly for reasons of funding politics. It's great to see that this divide has now been overcome.


    • Note that while all of these entries come from Saccharomyces cerevisiae, they have been sequenced in different yeast strains. Thus they don't have to be identical (except for the fact that this is a table of identical sequences), such related sequences might be slightly different because the strains are after all not genetically identical. And sometimes we find identical sequences in quite divergent species. Therefore I would not actually consider EIW11153.1, AJU86440.1, AJU58508.1, and AJU61971.1 to be identical proteins, although they have the same sequence.


    Note all the .1 suffixes of the sequence identifiers. These are version numbers. Two observations:

    1. It's great that version numbers are now used throughout the NCBI database. This is good database engineering practice because it's really important for reproducible research that updates to database records are possible, but recognizable. When working with data you always must provide for the possibility of updates, and manage the changes transparently and explicitly. Proper versioning should be a part of all datamodels. In fact, the NCBI has recently phased out its internal unique identifiers – the GI number – in favour of accession-number.version IDs everywhere.
    2. When searching, or for general use, you can (and should) omit the version number, i.e. use NP_010227 or P39678 not NP_010227.1 resp. P39678.1. This way the database system will resolve the identifier to the most current, highest version number (unless you want the older one, of course).


    Task:

    1. Note down the RefSeq ID and the UniProt (SwissProt) ID of Mbp1 in your journal.
    2. Follow the link to the RefSeq entry NP_010227.1.
    3. Explore the page and explore these links (note the contents in your journal):
      1. Under "Analyze this Sequence": Identify Conserved Domains
      2. Under "Protein 3D Structure": See all 3 structures...
      3. Under "Pathways for the MBP1 gene": Cell cycle - yeast
      4. Under "Related information" Proteins with Similar Sequence

    As we see, this is a good start page to explore all kinds of databases at the NCBI via cross-references.



     

    PubMed

    Arguably one of the most important databases in the life sciences is PubMed and this is a good time to look at PubMed in a bit more detail.


    Task:

    1. Return back to the MBP1 RefSeq record.
    2. Find the PubMed link under Related information in the right-hand margin and explore it. This are links that are directly related to the NP_010227 sequence in the database.
    3. Next follow the link to "PubMed (Weighted)" which applies a weighting algorithm to find broadly relevant information - an example of literature data mining. PubMed(weighted) appears to give a pretty good overview of systems-biology type, cross-sectional and functional information.

    But it does not find all Mbp1 related literature.

    1. On any of the PubMed pages open the Advanced query page and study the keywords that apply to PubMed searches. These are actually quite important and useful to remember. Make yourself familiar with the section on Search field descriptions and tags in the PubMed help document, (in particular [DP], [AU], [TI], and [TA]), how you use the History to combine searches, and the use of AND, OR, NOT and brackets. Understand how you can restrict a search to reviews only, and what the link to Related citations... is useful for[4].
    2. Now find publications from anywhere in PubMed with Mbp1 in the title. In the result list, follow the links for the two Biochemistry papers, by Taylor et al. (2000) and by Deleeuw et al. (2008). Download the PDFs, these manuscripts will be needed in a later unit.


     

    Digression: A "bookmarklet" to access literature

    PubMed usually includes links to full-text articles, but these are often behind a paywall, even though we have access through our library system (one of the top three in the world incidentally). Here is a bookmarklet (a portmanteau of "bookmark" and "applet") to seamlessly redirect from a paywall page to full access through our library's "my access" system. The key is to apply a bit of code that "rewrites" the original URL.

    • In your browser, create a bookmark to anything, call it "MyAccess"", and put it into your bookmarks bar for convenience. Then edit it: replace the URL of the bookmark with the following snip of Javascript:
    javascript:(function(){var url=window.location.href;var re=/\/([\w.]+)\/(.*$)/;var match=url.match(re);var newURL="http://"+match[1]+".myaccess.library.utoronto.ca/"+match[2];window.location.href=newURL;})();void 0
    

    No line breaks!

    Then try it. Go to the following article from outside the university network ...

     http://science.sciencemag.org/content/303/5659/788.long
    

    ... you should see the abstract but you can't view the full text without being an AAAS member. Then click on your bookmarklet. It should automatically rewrite the URL, take you to the UofT login screen, and take you to a page with full access to the article.

    I hope you find this as useful as I do. The strategy lends itself to other nice ideas.


     

    Original Information and Annotation Transfer

    Task:
    In the BIN-Storing_data unit you have found the protein of MYSPE that is most similar to yeast Mbp1, in MYSPE. Navigate to the NCBI Protein page for the RefSeq entry of this protein. Explore the links that go out from the page. Assess which resources are independently useful, and which resources merely recapitulate information that relates to yeast Mbp1, the protein that you originally searched with. The goal is to develop a sense for where a page like this one collects original information, and where it merely acts as a record of annotation transfer.


     

    Notes

    1. If you find this URL hard to remember, consider the acronyms:
      ncbi.nlm.nih.gov
      NCBI: National Center for Biotechnology Information
      NLM: National Library of Medicine
      NIH: National Institutes of Health
      GOV: the US GOVernment top-level domain
    2. If there is only a single match, you will be been taken directly to the page.
    3. Actually the "real" SwissProt identifier would be patterned like MBP1_YEAST. P39678 is the corresponding UniProt identifier.
    4. A good way to consolidate your knowledge is to summarize it for everyone on the Entrez page of the Student Wiki, or enhance the information you find there.


     


    About ...
     
    Author:

    Boris Steipe <boris.steipe@utoronto.ca>

    Created:

    2017-08-05

    Modified:

    2020-10-07

    Version:

    1.2

    Version history:

    • 1.2 Edit policy update
    • 1.1 2020 updates and revised marking
    • 1.0.1 Removed NCBI linkrot
    • 1.0 First live version
    • 0.1 First stub

    CreativeCommonsBy.png This copyrighted material is licensed under a Creative Commons Attribution 4.0 International License. Follow the link to learn more.