Difference between revisions of "BIO Assignment Week 4"
m |
m |
||
Line 2: | Line 2: | ||
<div class="b1"> | <div class="b1"> | ||
Assignment for Week 4<br /> | Assignment for Week 4<br /> | ||
− | <span style="font-size: 70%"> | + | <span style="font-size: 70%">Sequence alignment</span> |
</div> | </div> | ||
<table style="width:100%;"><tr> | <table style="width:100%;"><tr> | ||
Line 16: | Line 16: | ||
__TOC__ | __TOC__ | ||
+ | | ||
− | |||
==Introduction== | ==Introduction== | ||
+ | |||
+ | In this assignment we will perform an optimal global and local sequence alignment, and use '''R''' to plot the alignment quality as a colored bar-graph. | ||
+ | |||
+ | |||
+ | === Optimal sequence alignments === | ||
+ | |||
+ | |||
+ | Online programs for optimal sequence alignment are part of the EMBOSS tools. The programs take FASTA files as input. | ||
+ | |||
+ | ;Local optimal SEQUENCE alignment "water" | ||
+ | {{task|1= | ||
+ | # Retrieve the FASTA file for the YFO Mbp1 protein and for [http://www.ncbi.nlm.nih.gov/protein/NP_010227?report=fasta&log$=seqview&format=text ''Saccharomyces cerevisiae'']. | ||
+ | # Save the files as text files to your computer, (if you haven't done so already). You could give them an extension of <code>.fa</code>. | ||
+ | # Access the [http://emboss.bioinformatics.nl/ EMBOSS Explorer site] (if you haven't done so yet, you might want to bookmark it.) | ||
+ | # Look for '''ALIGNMENT LOCAL''', click on '''water''', paste your FASTA sequences and run the program with default parameters. | ||
+ | # Study the results. You will probably find that the alignment extends over most of the protein, but does not include the termini. | ||
+ | # Considering the sequence identy cutoff we discussed in class (25% over the length of a domain), do you believe that the APSES domains are homologous? | ||
+ | # Change the '''Gap opening''' and '''Gap extension''' parameters to high values (e.g. 30 and 5). Then run the alignment again. | ||
+ | # Note what is different. | ||
+ | # You could try getting only an alignment for the ankyrin domains that you have found in the last assignment, by deleting the approximate region of the APSES domains from your input. | ||
+ | }} | ||
+ | |||
+ | |||
+ | ;Global optimal SEQUENCE alignment "needle" | ||
+ | {{task|1= | ||
+ | # Look for '''ALIGNMENT GLOBAL''', click on '''needle''', paste your FASTA sequences and run the program with default parameters. | ||
+ | # Study the results. You will find that the alignment extends over the entire protein, likely with long ''indels'' at the termini. | ||
+ | # Change the '''Output alignment format''' to '''FASTA pairwise simple''', to retrieve the aligned FASTA files with indels. | ||
+ | # Copy the aligned sequences (with indels) and save them to your computer. You could give them an extension of <code>.fal</code> to remind you that they are aligned FASTA sequences. | ||
+ | }} | ||
+ | |||
| | ||
− | + | == The Mutation Data Matrix == | |
+ | |||
+ | The NCBI makes its alignment matrices available by ftp. They are located at ftp://ftp.ncbi.nih.gov/blast/matrices - for example here is a link to the [ftp://ftp.ncbi.nih.gov/blast/matrices/BLOSUM62 '''BLOSUM62 matrix''']<ref>The directory also contains sourcecode to generte the PAM matrices. This may be of interest for you if you ever want to produce scoring matrices from your own datasets.</ref>. Access that site and download the <code>BLOSUM62</code> matrix to your computer. You could give it a filename of <code>BLOSUM62.mdm</code>. | ||
+ | |||
+ | It should look like this. | ||
+ | |||
+ | <source lang="text"> | ||
+ | # Matrix made by matblas from blosum62.iij | ||
+ | # * column uses minimum score | ||
+ | # BLOSUM Clustered Scoring Matrix in 1/2 Bit Units | ||
+ | # Blocks Database = /data/blocks_5.0/blocks.dat | ||
+ | # Cluster Percentage: >= 62 | ||
+ | # Entropy = 0.6979, Expected = -0.5209 | ||
+ | A R N D C Q E G H I L K M F P S T W Y V B Z X * | ||
+ | A 4 -1 -2 -2 0 -1 -1 0 -2 -1 -1 -1 -1 -2 -1 1 0 -3 -2 0 -2 -1 0 -4 | ||
+ | R -1 5 0 -2 -3 1 0 -2 0 -3 -2 2 -1 -3 -2 -1 -1 -3 -2 -3 -1 0 -1 -4 | ||
+ | N -2 0 6 1 -3 0 0 0 1 -3 -3 0 -2 -3 -2 1 0 -4 -2 -3 3 0 -1 -4 | ||
+ | D -2 -2 1 6 -3 0 2 -1 -1 -3 -4 -1 -3 -3 -1 0 -1 -4 -3 -3 4 1 -1 -4 | ||
+ | C 0 -3 -3 -3 9 -3 -4 -3 -3 -1 -1 -3 -1 -2 -3 -1 -1 -2 -2 -1 -3 -3 -2 -4 | ||
+ | Q -1 1 0 0 -3 5 2 -2 0 -3 -2 1 0 -3 -1 0 -1 -2 -1 -2 0 3 -1 -4 | ||
+ | E -1 0 0 2 -4 2 5 -2 0 -3 -3 1 -2 -3 -1 0 -1 -3 -2 -2 1 4 -1 -4 | ||
+ | G 0 -2 0 -1 -3 -2 -2 6 -2 -4 -4 -2 -3 -3 -2 0 -2 -2 -3 -3 -1 -2 -1 -4 | ||
+ | H -2 0 1 -1 -3 0 0 -2 8 -3 -3 -1 -2 -1 -2 -1 -2 -2 2 -3 0 0 -1 -4 | ||
+ | I -1 -3 -3 -3 -1 -3 -3 -4 -3 4 2 -3 1 0 -3 -2 -1 -3 -1 3 -3 -3 -1 -4 | ||
+ | L -1 -2 -3 -4 -1 -2 -3 -4 -3 2 4 -2 2 0 -3 -2 -1 -2 -1 1 -4 -3 -1 -4 | ||
+ | K -1 2 0 -1 -3 1 1 -2 -1 -3 -2 5 -1 -3 -1 0 -1 -3 -2 -2 0 1 -1 -4 | ||
+ | M -1 -1 -2 -3 -1 0 -2 -3 -2 1 2 -1 5 0 -2 -1 -1 -1 -1 1 -3 -1 -1 -4 | ||
+ | F -2 -3 -3 -3 -2 -3 -3 -3 -1 0 0 -3 0 6 -4 -2 -2 1 3 -1 -3 -3 -1 -4 | ||
+ | P -1 -2 -2 -1 -3 -1 -1 -2 -2 -3 -3 -1 -2 -4 7 -1 -1 -4 -3 -2 -2 -1 -2 -4 | ||
+ | S 1 -1 1 0 -1 0 0 0 -1 -2 -2 0 -1 -2 -1 4 1 -3 -2 -2 0 0 0 -4 | ||
+ | T 0 -1 0 -1 -1 -1 -1 -2 -2 -1 -1 -1 -1 -2 -1 1 5 -2 -2 0 -1 -1 0 -4 | ||
+ | W -3 -3 -4 -4 -2 -2 -3 -2 -2 -3 -2 -3 -1 1 -4 -3 -2 11 2 -3 -4 -3 -2 -4 | ||
+ | Y -2 -2 -2 -3 -2 -1 -2 -3 2 -1 -1 -2 -1 3 -3 -2 -2 2 7 -1 -3 -2 -1 -4 | ||
+ | V 0 -3 -3 -3 -1 -2 -2 -3 -3 3 1 -2 1 -1 -2 -2 0 -3 -1 4 -3 -2 -1 -4 | ||
+ | B -2 -1 3 4 -3 0 1 -1 0 -3 -4 0 -3 -3 -2 0 -1 -4 -3 -3 4 1 -1 -4 | ||
+ | Z -1 0 0 1 -3 3 4 -2 0 -3 -3 1 -1 -3 -1 0 -1 -3 -2 -2 1 4 -1 -4 | ||
+ | X 0 -1 -1 -1 -2 -1 -1 -1 -1 -1 -1 -1 -1 -1 -2 0 0 -2 -1 -1 -1 -1 -1 -4 | ||
+ | * -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 1 | ||
+ | </source> | ||
+ | |||
+ | |||
+ | {{task| | ||
+ | * Study this and make sure you understand what this table is, how it can be used, and what a reasonable range of values for identities and pairscores for non-identical, similar and dissimilar residues is. Ask on the mailing list in case you have questions. | ||
+ | }} | ||
+ | |||
| | ||
+ | == The DNA binding site == | ||
+ | |||
− | + | Now, that you know how YFO Mbp1 aligns with yeast Mbp1, you can evaluate functional conservation in these homologous proteins. You probably already downloaded the two Biochemistry papers by Taylor et al. (2000) and by Deleeuw et al. (2008) that we encountered in Assignment 2. These discuss the residues involved in DNA binding<ref>([http://www.ncbi.nlm.nih.gov/pubmed/10747782 Taylor ''et al.'' (2000) ''Biochemistry'' '''39''': 3943-3954] and [http://www.ncbi.nlm.nih.gov/pubmed/18491920 Deleeuw ''et al.'' (2008) Biochemistry. '''47''':6378-6385])</ref>. In particular the residues between 50-74 have been proposed to comprise the DNA recognition domain. | |
− | + | {{task| | |
+ | # Using the APSES domain alignment you have just constructed, find the YFO Mbp1 residues that correspond to the range 50-74 in yeast. | ||
+ | # Note whether the sequences are especially highly conserved in this region. | ||
+ | # Using Chimera, look at the region. Use the sequence window '''to make sure''' that the sequence numbering between the paper and the PDB file are the same (they are often not identical!). Then select the residues - the proposed recognition domain - and color them differently for emphasis. Study this in stereo to get a sense of the spatial relationships. Check where the conserved residues are. | ||
+ | # A good representation is '''stick''' - but other representations that include sidechains will also serve well. | ||
+ | # Calculate a solvent accessible surface of the protein in a separate representation and make it transparent. | ||
+ | # You could combine three representations: (1) the backbone (in '''ribbon view'''), (2) the sidechains of residues that presumably contact DNA, distinctly colored, and (3) a transparent surface of the entire protein. This image should show whether residues annotated as DNA binding form a contiguous binding interface. | ||
+ | }} | ||
+ | |||
+ | |||
+ | DNA binding interfaces are expected to comprise a number of positively charged amino acids, that might form salt-bridges with the phosphate backbone. | ||
{{task| | {{task| | ||
− | + | *Study and consider whether this is the case here and which residues might be included. | |
+ | }} | ||
+ | |||
+ | |||
+ | | ||
+ | == R code: coloring the alignment by quality == | ||
+ | |||
+ | |||
+ | |||
+ | {{task|1= | ||
− | + | * Study this code carefully, execute it, section by section and make sure you understand all of it. Ask on the list if anything is not clear. | |
− | + | ||
+ | <source lang="R"> | ||
+ | # BiostringsExample.R | ||
+ | # Short tutorial on sequence alignment with the Biostrings package. | ||
+ | # Boris Steipe for BCH441, 2013 - 2014 | ||
+ | # | ||
+ | setwd("~/path/to/your/R_files/") | ||
+ | setwd("~/Documents/07.TEACHING/37-BCH441 Bioinformatics 2014/05-Materials/Assignment_5 data") | ||
+ | |||
+ | # Biostrings is a package within the bioconductor project. | ||
+ | # bioconducter packages have their own installation system, | ||
+ | # they are normally not installed via CRAN. | ||
+ | # First, you load the BioConductor installer... | ||
+ | source("http://bioconductor.org/biocLite.R") | ||
− | + | # Then you can install the Biostrings package and all of its dependencies. | |
+ | biocLite("Biostrings") | ||
− | + | # ... and load the library. | |
+ | library(Biostrings) | ||
− | + | # Some basic (technical) information is available ... | |
+ | library(help=Biostrings) | ||
− | + | # ... but for more in depth documentation, use the | |
− | + | # so called "vignettes" that are provided with every R package. | |
− | + | browseVignettes("Biostrings") | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | < | + | # In this code, we mostly use functions that are discussed in the |
+ | # pairwise alignement vignette. | ||
+ |
# Read in two fasta files - you will need to edit this for YFO | ||
+ | sacce <- readAAStringSet("mbp1-sacce.fa", format="fasta") | ||
− | + | # "USTMA" is used only as an example here - modify for YFO :-) | |
+ | ustma <- readAAStringSet("mbp1-ustma.fa", format="fasta") | ||
− | + | sacce | |
− | + | names(sacce) | |
− | + | names(sacce) <- "Mbp1 SACCE" | |
− | + | names(ustma) <- "Mbp1 USTMA" # Example only ... modify for YFO | |
− | |||
− | + | width(sacce) | |
− | + | as.character(sacce) | |
− | |||
− | + | # Biostrings takes a sophisticated approach to sequence alignment ... | |
+ | ?pairwiseAlignment | ||
− | + | # ... but the use in practice is quite simple: | |
− | + | ali <- pairwiseAlignment(sacce, ustma, substitutionMatrix = "BLOSUM50") | |
+ | ali | ||
− | + | pattern(ali) | |
− | + | subject(ali) | |
− | |||
− | |||
− | + | writePairwiseAlignments(ali) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | p <- aligned(pattern(ali)) | |
− | + | names(p) <- "Mbp1 SACCE aligned" | |
− | + | s <- aligned(subject(ali)) | |
− | + | names(s) <- "Mbp1 USTMA aligned" | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | # | + | # don't overwrite your EMBOSS .fal files |
− | + | writeXStringSet(p, "mbp1-sacce.R.fal", append=FALSE, format="fasta") | |
− | + | writeXStringSet(s, "mbp1-ustma.R.fal", append=FALSE, format="fasta") | |
− | |||
− | |||
− | # | + | # Done. |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
</source> | </source> | ||
+ | |||
+ | * Compare the alignments you received from the EMBOSS server, and that you co puted using '''R'''. Are they aproximately the same? Exactly? You did use different matrices and gap aameters, so minor differences are to be expected. But by and large you should get the same alignments. | ||
+ | |||
}} | }} | ||
− | + | We will now use the aligned sequences to compute a graphical display of alignment quality. | |
− | |||
{{task|1= | {{task|1= | ||
− | + | * Study this code carefully, execute it, section by section and make sure you understand all of it. Ask on the list if anything is not clear. | |
− | <source lang=" | + | <source lang="R"> |
− | + | # aliScore.R | |
+ | # Evaluating an alignment with a sliding window score | ||
+ | # Boris Steipe, October 2012. Update October 2013 | ||
+ | setwd("~/path/to/your/R_files/") | ||
− | # | + | # Scoring matrices can be found at the NCBI. |
− | + | # ftp://ftp.ncbi.nih.gov/blast/matrices/BLOSUM62 | |
− | # | + | # It is good practice to set variables you might want to change |
− | + | # in a header block so you don't need to hunt all over the code | |
− | + | # for strings you need to update. | |
− | + | # | |
− | + | fa1 <- "mbp1-sacce.R.fal" | |
+ | fa2 <- "mbp1-ustma.R.fal" | ||
+ | code1 <- "SACCE" | ||
+ | code2 <- "USTMA" | ||
+ | mdmFile <- "BLOSUM62.mdm" | ||
+ | window <- 9 # window-size (should be an odd integer) | ||
− | + | # ================================================ | |
− | + | # Read data files | |
− | + | # ================================================ | |
− | |||
− | |||
− | |||
− | + | # read fasta datafiles using seqinr function read.fasta() | |
− | + | install.packages("seqinr") | |
+ | library(seqinr) | ||
+ | tmp <- unlist(read.fasta(fa1, seqtype="AA", as.string=FALSE, seqonly=TRUE)) | ||
+ | seq1 <- unlist(strsplit(as.character(tmp), split="")) | ||
− | + | tmp <- unlist(read.fasta(fa2, seqtype="AA", as.string=FALSE, seqonly=TRUE)) | |
− | + | seq2 <- unlist(strsplit(as.character(tmp), split="")) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | if (length(seq1) != length(seq2)) { | |
− | + | print("Error: Sequences have unequal length!") | |
− | + | } | |
− | + | ||
+ | lSeq <- length(seq1) | ||
+ | # ================================================ | ||
+ | # Read scoring matrix | ||
+ | # ================================================ | ||
− | # | + | MDM <- read.table(mdmFile, skip=6) |
− | + | ||
− | + | # This is a dataframe. Study how it can be accessed: | |
− | + | ||
− | + | MDM | |
− | + | MDM[1,] | |
− | + | MDM[,1] | |
− | + | MDM[5,5] # Cys-Cys | |
− | + | MDM[20,20] # Val-Val | |
− | + | MDM[,"W"] # the tryptophan column | |
− | + | MDM["R","W"] # Arg-Trp pairscore | |
− | + | MDM["W","R"] # Trp-Arg pairscore: pairscores are symmetric | |
− | < | + | |
− | + | colnames(MDM) # names of columns | |
+ | rownames(MDM) # names of rows | ||
+ | colnames(MDM)[3] # third column | ||
+ | rownames(MDM)[12] # twelfth row | ||
+ | |||
+ | # change the two "*" names to "-" so we can use them to score | ||
+ | # indels of the alignment. This is a bit of a hack, since this | ||
+ | # does not reflect the actual indel penalties (which is, as you) | ||
+ | # remember from your lectures, calculated as a gap opening | ||
+ | # + gap extension penalty; it can't be calculated in a pairwise | ||
+ | # manner) EMBOSS defaults for BLODSUM62 are opening -10 and | ||
+ | # extension -0.5 i.e. a gap of size 3 (-11.5) has approximately | ||
+ | # the same penalty as a 3-character score of "-" matches (-12) | ||
+ | # so a pairscore of -4 is not entirely unreasonable. | ||
+ | |||
+ | colnames(MDM)[24] | ||
+ | rownames(MDM)[24] | ||
+ | colnames(MDM)[24] <- "-" | ||
+ | rownames(MDM)[24] <- "-" | ||
+ | colnames(MDM)[24] | ||
+ | rownames(MDM)[24] | ||
+ | MDM["Q", "-"] | ||
+ | MDM["-", "D"] | ||
+ | # so far so good. | ||
+ | # ================================================ | ||
+ | # Tabulate pairscores for alignment | ||
+ | # ================================================ | ||
− | |||
− | + | # It is trivial to create a pairscore vector along the | |
+ | # length of the aligned sequences. | ||
− | < | + | PS <- vector() |
− | for ( | + | for (i in 1:lSeq) { |
− | < | + | aa1 <- seq1[i] |
+ | aa2 <- seq2[i] | ||
+ | PS[i] = MDM[aa1, aa2] | ||
} | } | ||
− | |||
− | + | PS | |
− | + | ||
+ | |||
+ | # The same vector could be created - albeit perhaps not so | ||
+ | # easy to understand - with the expression ... | ||
+ | MDM[cbind(seq1,seq2)] | ||
+ | |||
+ | |||
+ | |||
+ | # ================================================ | ||
+ | # Calculate moving averages | ||
+ | # ================================================ | ||
+ | |||
+ | # In order to evaluate the alignment, we will calculate a | ||
+ | # sliding window average over the pairscores. Somewhat surprisingly | ||
+ | # R doesn't (yet) have a native function for moving averages: options | ||
+ | # that are quoted are: | ||
+ | # - rollmean() in the "zoo" package http://rss.acs.unt.edu/Rdoc/library/zoo/html/rollmean.html | ||
+ | # - MovingAverages() in "TTR" http://rss.acs.unt.edu/Rdoc/library/TTR/html/MovingAverages.html | ||
+ | # - ma() in "forecast" http://robjhyndman.com/software/forecast/ | ||
+ | # But since this is easy to code, we shall implement it ourselves. | ||
+ | |||
+ | PSma <- vector() # will hold the averages | ||
+ | winS <- floor(window/2) # span of elements above/below the centre | ||
+ | winC <- winS+1 # centre of the window | ||
+ | |||
+ | # extend the vector PS with zeros (virtual observations) above and below | ||
+ | PS <- c(rep(0, winS), PS , rep(0, winS)) | ||
+ | |||
+ | # initialize the window score for the first position | ||
+ | winScore <- sum(PS[1:window]) | ||
+ | |||
+ | # write the first score to PSma | ||
+ | PSma[1] <- winScore | ||
− | + | # Slide the window along the sequence, and recalculate sum() | |
− | # | + | # Loop from the next position, to the last position that does not exceed the vector... |
− | for (i in 1: | + | for (i in (winC + 1):(lSeq + winS)) { |
− | + | # subtract the value that has just dropped out of the window | |
+ | winScore <- winScore - PS[(i-winS-1)] | ||
+ | # add the value that has just entered the window | ||
+ | winScore <- winScore + PS[(i+winS)] | ||
+ | # put score into PSma | ||
+ | PSma[i-winS] <- winScore | ||
} | } | ||
− | # | + | # convert the sums to averages |
− | + | PSma <- PSma / window | |
− | + | ||
− | + | # have a quick look at the score distributions | |
+ | |||
+ | boxplot(PSma) | ||
+ | hist(PSma) | ||
− | # . | + | # ================================================ |
− | + | # Plot the alignment scores | |
− | + | # ================================================ | |
− | + | ||
+ | # normalize the scores | ||
+ | PSma <- (PSma-min(PSma))/(max(PSma) - min(PSma) + 0.0001) | ||
+ | # spread the normalized values to a desired range, n | ||
+ | nCol <- 10 | ||
+ | PSma <- floor(PSma * nCol) + 1 | ||
+ | |||
+ | # Assign a colorspectrum to a vector (with a bit of colormagic, | ||
+ | # don't worry about that for now). Dark colors are poor scores, | ||
+ | # "hot" colors are high scores | ||
+ | spect <- colorRampPalette(c("black", "red", "yellow", "white"), bias=0.4)(nCol) | ||
− | + | # Color is an often abused aspect of plotting. One can use color to label | |
+ | # *quantities* or *qualities*. For the most part, our pairscores measure amino | ||
+ | # acid similarity. That is a quantity and with the spectrum that we just defined | ||
+ | # we associte the measured quantities with the color of a glowing piece | ||
+ | # of metal: we start with black #000000, then first we ramp up the red | ||
+ | # (i.e. low-energy) part of the visible spectrum to red #FF0000, then we | ||
+ | # add and ramp up the green spectrum giving us yellow #FFFF00 and finally we | ||
+ | # add blue, giving us white #FFFFFF. Let's have a look at the spectrum: | ||
− | + | s <- rep(1, nCol) | |
+ | barplot(s, col=spect, axes=F, main="Color spectrum") | ||
− | + | # But one aspect of our data is not quantitatively different: indels. | |
+ | # We valued indels with pairscores of -4. But indels are not simply poor alignment, | ||
+ | # rather they are non-alignment. This means stretches of -4 values are really | ||
+ | # *qualitatively* different. Let's color them differently by changing the lowest | ||
+ | # level of the spectrum to grey. | ||
+ | spect[1] <- "#CCCCCC" | ||
+ | barplot(s, col=spect, axes=F, main="Color spectrum") | ||
− | + | # Now we can display our alignment score vector with colored rectangles. | |
− | + | # Convert the integers in PSma to color values from spect | |
− | + | PScol <- vector() | |
− | < | + | for (i in 1:length(PSma)) { |
− | + | PScol[i] <- spect[ PSma[i] ] # this is how a value from PSma is used as an index of spect | |
− | # | + | } |
− | |||
− | |||
− | |||
− | |||
− | |||
− | # | + | # Plot the scores. The code is similar to the last assignment. |
− | + | # Create an empty plot window of appropriate size | |
− | # | + | plot(1,1, xlim=c(-100, lSeq), ylim=c(0, 2) , type="n", yaxt="n", bty="n", xlab="position in alignment", ylab="") |
− | |||
− | + | # Add a label to the left | |
− | + | text (-30, 1, adj=1, labels=c(paste("Mbp1:\n", code1, "\nvs.\n", code2)), cex=0.9 ) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | # Loop over the vector and draw boxes without border, filled with color. | |
− | + | for (i in 1:lSeq) { | |
− | + | rect(i, 0.9, i+1, 1.1, border=NA, col=PScol[i]) | |
− | |||
− | |||
− | |||
} | } | ||
+ | |||
+ | # Note that the numbers along the X-axis are not sequence numbers, but numbers | ||
+ | # of the alignment, i.e. sequence number + indel length. That is important to | ||
+ | # realize: if you would like to add the annotations from the last assignment | ||
+ | # which I will leave as an exercise, you need to map your sequence numbering | ||
+ | # into alignment numbering. Let me know in case you try that but need some help. | ||
+ | |||
</source> | </source> | ||
}} | }} | ||
− | |||
− | + | ;That is all. | |
+ | |||
+ | |||
+ | | ||
+ | |||
+ | | ||
+ | ==Introduction== | ||
+ | |||
+ | <div style="padding: 2px; background: #F0F1F7; border:solid 1px #AAAAAA; font-size:125%;color:#444444"> | ||
+ | |||
+ | |||
+ | <br> | ||
+ | |||
+ | ;Take care of things, and they will take care of you. | ||
+ | :''Shunryu Suzuki'' | ||
+ | </div> | ||
+ | |||
+ | |||
+ | Anyone can click buttons on a Web page, but to use the powerful sequence database search tools ''right'' often takes considerable more care, caution and consideration. | ||
+ | |||
+ | Much of what we know about a protein's physiological function is based on the '''conservation''' of that function as the species evolves. We assess conservation by comparing sequences between related proteins. Conservation - or its opposite: ''variation'' - is a consequence of '''selection under constraints''': protein sequences change as a consequence of DNA mutations, this changes the protein's structure, this in turn changes functions and that has the multiple effects on a species' fitness function. Detrimental variants may be removed. Variation that is tolerated is largely neutral and therefore found only in positions that are neither structurally nor functionally critical. Conservation patterns can thus provide evidence for many different questions: structural conservation among proteins with similar 3D-structures, functional conservation among homologues with comparable roles, or amino acid propensities as predictors for protein engineering and design tasks. | ||
+ | |||
+ | Measuring conservation requires alignment. Therefore a carefully done multiple sequence alignment ('''MSA''') is a cornerstone for the annotation of the essential properties a gene or protein. MSAs are also useful to resolve ambiguities in the precise placement of indels and to ensure that columns in alignments actually contain amino acids that evolve in a similar context. MSAs serve as input for | ||
+ | * functional annotation; | ||
+ | * protein homology modeling; | ||
+ | * phylogenetic analyses, and | ||
+ | * sensitive homology searches in databases. | ||
+ | |||
+ | In order to perform a multiple sequence alignment, we obviously need a set of homologous sequences. This is where the trouble begins. All interpretation of MSA results depends '''absolutely''' on how the input sequences were chosen. Should we include only orthologs, or paralogs as well? Should we include only species with fully sequenced genomes, or can we tolerate that some orthologous genes are possibly missing for a species? Should we include all sequences we can lay our hands on, or should we restrict the selection to a manageable number of ''representative'' sequences? All of these choices influence our interpretation: | ||
+ | *orthologs are expected to be functionally and structurally conserved; | ||
+ | *paralogs may have divergent function but have similar structure; | ||
+ | *missing genes may make paralogs look like orthologs; and | ||
+ | *selection bias may weight our results toward sequences that are over-represented and do not provide a fair representation of evolutionary divergence. | ||
+ | |||
+ | |||
+ | In this assignment, we will set ourselves the task to use PSI-BLAST and '''find all orthologs and paralogs of the APSES domain containing transcription factors in YFO'''. We will use these sequences later for multiple alignments, calculation of conservation ''etc''. The methodical problem we will address is: how do we perform a sensitive PSI-BLAST search '''in one organism'''. There is an issue to consider: | ||
+ | * If we restrict the PSI-BLAST search to YFO, PSI-BLAST has little chance of building a meaningful profile - the number of homologues that actually are '''in''' YFO is too small. Thus the search will not become very sensitive. | ||
+ | * If we don't restrict our search, but search in all species, the number of hits may become too large. It becomes increasingly difficult to closely check all hits as to whether they have good coverage, and how will we evaluate the fringe cases of marginal E-value, where we need to decide whether to include a new sequence in the profile, or whether to hold off on it for one or two iterations, to see whether the E-value drops significantly. Profile corruption would make the search useless. This is maybe still manageable if we restrict our search to fungi, but imagine you are working with a bacterial protein, or a protein that is conserved across the entire tree of life: your search will find thousands of sequences. And by next year, thousands more will have been added. | ||
+ | |||
+ | Therefore we have to find a middle ground: add enough species (sequences) to compile a sensitive profile, but not so many that we can no longer individually assess the sequences that contribute to the profile. | ||
+ | |||
+ | |||
+ | Thus in practice, a sensitive PSI-BLAST search needs to address two issues before we begin: | ||
+ | # We need to define the sequence we are searching with; and | ||
+ | # We need to define the dataset we are searching in. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ==Defining the sequence to search with== | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | Consider again the task we set out from: '''find all orthologs and paralogs of the APSES domain containing transcription factors in YFO'''. | |
− | |||
{{task|1= | {{task|1= | ||
+ | What query sequence should you use? Should you ... | ||
− | |||
− | + | # Search with the full-length Mbp1 sequence from ''Saccharomyces cerevisiae''? | |
− | + | # Search with the full-length Mbp1 homolog that you found in YFO? | |
− | # | + | # Search with the structurally defined ''S. cerevisiae'' APSES domain sequence? |
+ | # Search with the APSES domain sequence from the YFO homolog, that you have defined by sequence alignment with the yeast protein? | ||
+ | # Search with the KilA-N domain sequence? | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | ; | + | <div class="mw-collapsible mw-collapsed" data-expandtext="Expand" data-collapsetext="Collapse" style="border:#000000 solid 1px; padding: 10px; margin-left:25px; margin-right:25px;">Reflect on this (pretend this is a quiz question) and come up with a reasoned answer. Then click on "Expand" to read my opinion on this question. |
− | < | + | <div class="mw-collapsible-content"> |
− | + | ;The full-length Mbp1 sequence from ''Saccharomyces cerevisiae'' | |
− | </ | + | :Since this sequence contains multiple domains (in particular the ubiquitous Ankyrin domains) it is not suitable for BLAST database searches. You must restrict your search to the domain of greatest interest for your question. That would be the APSES domain. |
− | + | ||
+ | ;The full-length Mbp1 homolog that you found in YFO | ||
+ | :What organism the search sequence comes from does not make a difference. Since you aim to find '''all''' homologs in YFO, it is not necessary to have your search sequence more or less similar to '''any particular''' homologs. In fact '''any''' APSES sequence should give you the same result, since they are '''all''' homologous. But the full-length sequence in YFO has the same problem as the ''Saccharomyces'' sequence. | ||
+ | |||
+ | ;The structurally defined ''S. cerevisiae'' APSES domain sequence? | ||
+ | :That would be my first choice, just because it is structurally well defined as a complete domain, and the sequence is easy to obtain from the <code>1BM8</code> PDB entry. (<code>1MB1</code> would also work, but you would need to edit out the penta-Histidine tag at the C-terminus that was engineered into the sequence to help purify the recombinantly expressed protein.) | ||
− | + | ;The APSES domain sequence from the YFO homolog, that you have defined by sequence alignment with the yeast protein? | |
+ | :As argued above: since they are all homologs, any of them should lead to the same set of results. | ||
− | + | ;The KilA-N domain sequence? | |
+ | :This is a shorter sequence and a more distant homolog to the domain we are interested in. It would not be my first choice: the fact that it is more distantly related might make the search '''more sensitive'''. The fact that it is shorter might make the search '''less specific'''. The effect of this tradeoff would need to be compared and considered. By the way: the same holds for the even shorter subdomain 50-74 we discussed in the last assignment. However: one of the results of our analysis will be '''whether APSES domains in fungi all have the same length as the Mbp1 domain, or whether some are indeed much shorter, as suggested by the Pfam alignment.''' | ||
− | |||
− | + | So in my opinion, you should search with the yeast Mbp1 APSES domain, i.e. the sequence which you have previously studied in the crystal structure. Where is that? Well, you might have saved it in your journal, or you can get it again from the [http://www.pdb.org/pdb/explore/explore.do?structureId=1BM8 '''PDB'''] (i.e. [http://www.pdb.org/pdb/files/fasta.txt?structureIdList=1BM8 here], or from [[BIO_Assignment_Week_3#Search input|Assignment 3]]. | |
− | + | </div> | |
− | + | </div> | |
− | |||
− | |||
− | |||
}} | }} | ||
+ | | ||
− | + | ==Selecting species for a PSI-BLAST search== | |
+ | |||
+ | |||
+ | As discussed in the introduction, in order to use our sequence set for studying structural and functional features and conservation patterns of our APSES domain proteins, we should start with a well selected dataset of APSES domain containing homologs in YFO. Since these may be quite divergent, we can't rely on '''BLAST''' to find all of them, we need to use the much more sensitive search of '''PSI-BLAST''' instead. But even though you are interested only in YFO's genes, it would be a mistake to restrict the PSI-BLAST search to YFO. PSI-BLAST becomes more sensitive if the profile represents more diverged homologs. Therefore we should always search with a broadly representative set of species, even if we are interested only in the results for one of the species. This is important. Please reflect on this for a bit and make sure you understand the rationale why we include sequences in the search that we are not actually interested in. | ||
− | |||
− | + | But you can also search with '''too many''' species: if the number of species is large and PSI-BLAST finds a large number of results: | |
+ | # it becomes unwieldy to check the newly included sequences at each iteration, inclusion of false-positive hits may result, profile corruption and loss of specificity. The search will fail. | ||
+ | # since genomes from some parts of the Tree Of Life are over represented, the inclusion of all sequences leads to selection bias and loss of sensitivity. | ||
− | + | We should therefore try to find a subset of species | |
− | # | + | # that represent as large a '''range''' as possible on the evolutionary tree; |
− | # | + | # that are as well '''distributed''' as possible on the tree; and |
− | + | # whose '''genomes''' are fully sequenced. | |
− | |||
− | |||
− | |||
− | # | ||
− | |||
− | |||
− | + | These criteria are important. Again, reflect on them and understand their justification. Choosing your species well for a PSI-BLAST search can be crucial to obtain results that are robust and meaningful. | |
+ | How can we '''define''' a list of such species, and how can we '''use''' the list? | ||
− | The | + | The definition is a rather typical bioinformatics task for integrating datasources: "retrieve a list of representative fungi with fully sequenced genomes". Unfortunately, to do this in a principled way requires tools that you can't (yet) program: we would need to use a list of genome sequenced fungi, estimate their evolutionary distance and select a well-distributed sample. Regrettably you can't combine such information easily with the resources available from the NCBI. |
+ | We will use an approach that is conceptually similar: selecting a set of species according to their shared taxonomic rank in the tree of life. {{WP|Biological classification|'''Biological classification'''}} provides a hierarchical system that describes evolutionary relatedness for all living entities. The levels of this hierarchy are so called {{WP|Taxonomic rank|'''taxonomic ranks'''}}. These ranks are defined in ''Codes of Nomenclature'' that are curated by the self-governed international associations of scientists working in the field. The number of ranks is not specified: there is a general consensus on seven principal ranks (see below, in bold) but many subcategories exist and may be newly introduced. It is desired–but not mandated–that ranks represent ''clades'' (a group of related species, or a "branch" of a phylogeny), and it is desired–but not madated–that the rank is sharply defined. The system is based on subjective dissimilarity. Needless to say that it is in flux. | ||
− | = | + | If we follow a link to an entry in the NCBI's Taxonomy database, eg. [http://www.ncbi.nlm.nih.gov/Taxonomy/Browser/wwwtax.cgi?id=559292 ''Saccharomyces cerevisiae S228c''], the strain from which the original "yeast genome" was sequenced in the late 1990s, we see the following specification of its taxonomic lineage: |
− | + | <source lang="text"> | |
− | < | + | cellular organisms; Eukaryota; Opisthokonta; Fungi; Dikarya; |
− | + | Ascomycota; Saccharomyceta; Saccharomycotina; Saccharomycetes; | |
− | + | Saccharomycetales; Saccharomycetaceae; Saccharomyces; Saccharomyces cerevisiae | |
− | + | </source> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | These names can be mapped into taxonomic ranks ranks, since the suffixes of these names e.g. ''-mycotina'', ''-mycetaceae'' are specific to defined ranks. (NCBI does not provide this mapping, but {{WP|Taxonomic rank|Wikipedia}} is helpful here.) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <table> | |
− | + | <tr class="sh"> | |
+ | <td>Rank</td> | ||
+ | <td>Suffix</td> | ||
+ | <td>Example</td> | ||
+ | </tr> | ||
− | = | + | <tr class="s1"> |
+ | <td>Domain</td> | ||
+ | <td></td> | ||
+ | <td>Eukaryota (Eukarya)</td> | ||
+ | </tr> | ||
+ | <tr class="s2"> | ||
+ | <td> Subdomain</td> | ||
+ | <td> </td> | ||
+ | <td>Opisthokonta</td> | ||
+ | </tr> | ||
− | + | <tr class="s1"> | |
+ | <td>'''Kingdom'''</td> | ||
+ | <td> </td> | ||
+ | <td>Fungi</td> | ||
+ | </tr> | ||
− | + | <tr class="s2"> | |
+ | <td> Subkingdom</td> | ||
+ | <td> </td> | ||
+ | <td>Dikarya</td> | ||
+ | </tr> | ||
− | + | <tr class="s1"> | |
+ | <td>'''Phylum'''</td> | ||
+ | <td> </td> | ||
+ | <td>Ascomycota</td> | ||
+ | </tr> | ||
− | + | <tr class="s2"> | |
− | < | + | <td> ''rankless taxon''<ref>The -myceta are well supported groups above the Class rank. See {{WP|Leotiomyceta|''Leotiomyceta''}} for details and references.</ref></td> |
+ | <td>-myceta</td> | ||
+ | <td>Saccharomyceta</td> | ||
+ | </tr> | ||
− | + | <tr class="s1"> | |
− | + | <td> Subphylum</td> | |
+ | <td>-mycotina</td> | ||
+ | <td>Saccharomycotina</td> | ||
+ | </tr> | ||
+ | <tr class="s2"> | ||
+ | <td>'''Class'''</td> | ||
+ | <td>-mycetes</td> | ||
+ | <td>Saccharomycetes</td> | ||
+ | </tr> | ||
− | + | <tr class="s1"> | |
− | + | <td> Subclass</td> | |
− | + | <td>-mycetidae</td> | |
+ | <td> </td> | ||
+ | </tr> | ||
− | + | <tr class="s2"> | |
+ | <td>'''Order'''</td> | ||
+ | <td>-ales</td> | ||
+ | <td>Saccharomycetales</td> | ||
+ | </tr> | ||
− | + | <tr class="s1"> | |
− | + | <td>'''Family'''</td> | |
− | + | <td>-aceae</td> | |
− | + | <td>Saccharomycetaceae</td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <tr class="s2"> | |
− | + | <td> Subfamily</td> | |
− | + | <td>-oideae</td> | |
− | + | <td> </td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <tr class="s1"> | |
− | + | <td> Tribe</td> | |
− | + | <td>-eae</td> | |
− | + | <td> </td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <tr class="s2"> | |
− | + | <td> Subtribe</td> | |
− | + | <td>-ineae</td> | |
− | + | <td> </td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <tr class="s1"> | |
− | + | <td>'''Genus'''</td> | |
− | + | <td> </td> | |
− | + | <td>Saccharomyces</td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <tr class="s2"> | |
− | + | <td>'''Species'''</td> | |
− | + | <td> </td> | |
− | + | <td>''Saccharomyces cerevisiae''</td> | |
− | + | </tr> | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
+ | <table> | ||
− | |||
− | |||
− | |||
− | + | You can see that there is not a common mapping between the yeast lineage and the commonly recognized categories - not all ranks are represented. Nor is this consistent across species in the taxonomic database: some have subfamily ranks and some don't. And the tree is in no way normalized - some of the ranks have thousands of members, and for some, only a single extant member may be known, or it may be a rank that only relates to the fossil record. But the ranks do provide some guidance to evolutionary divergence. Say you want to choose four species across the tree of life for a study, you should choose one from each of the major '''domains''' of life: Eubacteria, Euryarchaeota, Crenarchaeota-Eocytes, and Eukaryotes. Or you want to study a gene that is specific to mammals. Then you could choose from the clades listed in the NCBI taxonomy database under [http://www.ncbi.nlm.nih.gov/Taxonomy/Browser/wwwtax.cgi?id=40674&lvl=4 '''Mammalia'''] (a {{WP|Mammal_classification|'''class rank'''}}, and depending how many species you would want to include, use the | |
− | + | subclass-, order-, or family rank (hover over the names to see their taxonomic rank.) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | There will still be quite a bit of manual work involved and an exploration of different options on the Web may be useful. For our purposes here we can retrieve a good set of organisms from the [http://fungi.ensembl.org/info/website/species.html '''ensembl fungal genomes page'''] - maintained by the EBI's genome annotation group - that lists species grouped by taxonomic ''order''. All of these organisms are genome-sequenced, we can pick a set of representatives: | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | # Capnodiales ''Zymoseptoria tritici'' | |
− | + | # Erysiphales ''Blumeria graminis'' | |
− | + | # Eurotiales ''Aspergillus nidulans'' | |
− | + | # Glomerellales ''Glomerella graminicola'' | |
− | + | # Hypocreales ''Trichoderma reesei'' | |
− | + | # Magnaporthales ''Magnaporthe oryzae'' | |
− | + | # Microbotryales ''Microbotryum violaceum'' | |
+ | # Pezizales ''Tuber melanosporum'' | ||
+ | # Pleosporales ''Phaeosphaeria nodorum'' | ||
+ | # Pucciniales ''Puccinia graminis'' | ||
+ | # Saccharomycetales ''Saccharomyces cerevisiae'' | ||
+ | # Schizosaccharomycetales ''Schizosaccharomyces pombe'' | ||
+ | # Sclerotiniaceae ''Sclerotinia sclerotiorum'' | ||
+ | # Sordariales ''Neurospora crassa'' | ||
+ | # Tremellales ''Cryptococcus neoformans'' | ||
+ | # Ustilaginales ''Ustilago maydis'' | ||
− | + | This set of organisms thus can be used to generate a PSI-BLAST search in a well-distributed set of species. Of course '''you must also include YFO''' (<small>if YFO is not in this list already</small>). | |
− | |||
− | |||
− | |||
− | + | To enter these 16 species as an Entrez restriction, they need to be formatted as below. (<small>One could also enter species one by one, by pressing the '''(+)''' button after the organism list</small>) | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | <source lang="text"> | |
+ | Aspergillus nidulans[orgn] | ||
+ | OR Blumeria graminis[orgn] | ||
+ | OR Cryptococcus neoformans[orgn] | ||
+ | OR Glomerella graminicola[orgn] | ||
+ | OR Magnaporthe oryzae[orgn] | ||
+ | OR Microbotryum violaceum[orgn] | ||
+ | OR Neurospora crassa[orgn] | ||
+ | OR Phaeosphaeria nodorum[orgn] | ||
+ | OR Puccinia graminis[orgn] | ||
+ | OR Sclerotinia sclerotiorum[orgn] | ||
+ | OR Trichoderma reesei[orgn] | ||
+ | OR Tuber melanosporum[orgn] | ||
+ | OR Saccharomyces cerevisiae[orgn] | ||
+ | OR Schizosaccharomyces pombe[orgn] | ||
+ | OR Ustilago maydis[orgn] | ||
+ | OR Zymoseptoria tritici[orgn] | ||
</source> | </source> | ||
+ | |||
+ | |||
+ | |||
+ | | ||
+ | |||
+ | ==Executing the PSI-BLAST search== | ||
+ | |||
+ | We have a list of species. Good. Next up: how do we '''use''' it. | ||
+ | |||
+ | {{task|1= | ||
+ | |||
+ | |||
+ | # Navigate to the BLAST homepage. | ||
+ | # Select '''protein BLAST'''. | ||
+ | # Paste the APSES domain sequence into the search field. | ||
+ | # Select '''refseq''' as the database. | ||
+ | # Copy the organism restriction list from above '''and enter the correct name for YFO''' into the list if it is not there already. Obviously, you can't find sequences in YFO if YFO is not included in your search space. Paste the list into the '''Entrez Query''' field. | ||
+ | # In the '''Algorithm''' section, select PSI-BLAST. | ||
+ | #Click on '''BLAST'''. | ||
}} | }} | ||
− | + | Evaluate the results carefully. Since we used default parameters, the threshold for inclusion was set at an '''E-value''' of 0.005 by default, and that may be a bit too lenient. If you look at the table of your hits– in the '''Sequences producing significant alignments...''' section– there may also be a few sequences that have a low query coverage of less than 80%. Let's exclude these from the profile initially: not to worry, if they are true positives, the will come back with improved E-values and greater coverage in subsequent iterations. But if they were false positives, their E-values will rise and they should drop out of the profile and not contaminate it. | |
− | |||
− | |||
{{task|1= | {{task|1= | ||
+ | #In the header section, click on '''Formatting options''' and in the line "Format for..." set the '''with inclusion threshold''' to <code>0.001</code> (This means E-values can't be above 10<sup>-03</sup> for the sequence to be included.) | ||
+ | # Click on the '''Reformat''' button (top right). | ||
+ | # In the table of sequence descriptions (not alignments!), click on the '''Query coverage''' to sort the table by coverage, not by score. | ||
+ | # Copy the rows with a coverage of less than 80% and paste them into some text editor so you can compare what happens with these sequences in the next iteration. | ||
+ | # '''Deselect''' the check mark next to these sequences in the right-hand column '''Select for PSI blast'''. (For me these are six sequences, but with YFO included that may be a bit different.) | ||
+ | # Then scroll to '''Run PSI-BLAST iteration 2 ...''' and click on '''<code>Go</code>'''. | ||
+ | }} | ||
+ | |||
+ | |||
+ | This is now the "real" PSI-BLAST at work: it constructs a profile from all the full-length sequences and searches with the '''profile''', not with any individual sequence. Note that we are controlling what goes into the profile in two ways: | ||
+ | # we are explicitly removing sequences with poor coverage; and | ||
+ | # we are requiring a more stringent minimum E-value for each sequence. | ||
− | |||
− | # | + | {{task|1= |
− | # | + | #Again, study the table of hits. Sequences highlighted in yellow have met the search criteria in the second iteration. Note that the coverage of (some) of the previously excluded sequences is now above 80%. |
− | # | + | # Let's exclude partial matches one more time. Again, deselect all sequences with less than 80% coverage. Then run the third iteration. |
− | + | # Iterate the search in this way until no more "New" sequences are added to the profile. Then scan the list of excluded hits ... are there any from YFO that seem like they could potentially make the list? Marginal E-value perhaps, or reasonable E-value but less coverage? If that's the case, try returning the E-value threshold to the default 0.005 and see what happens... | |
}} | }} | ||
+ | |||
+ | Once no "new" sequences have been added, if we were to repeat the process again and again, we would always get the same result because the profile stays the same. We say that the search has '''converged'''. Good. Time to harvest. | ||
+ | |||
+ | |||
+ | {{task|1= | ||
+ | # At the header, click on '''Taxonomy reports''' and find YFO in the '''Organism Report''' section. These are your APSES domain homologs. All of them. Actually, perhaps more than all: the report may also include sequences with E-values above the inclusion threshold. | ||
+ | # From the report copy the sequence identifiers | ||
+ | ## from YFO, | ||
+ | ## with E-values above your defined threshold. | ||
+ | }} | ||
+ | |||
+ | For example, the list of ''Saccharomyces'' genes is the following: | ||
+ | |||
+ | <code> | ||
+ | <b>[http://www.ncbi.nlm.nih.gov/Taxonomy/Browser/wwwtax.cgi?id=559292 Saccharomyces cerevisiae S288c]</b> [http://www.ncbi.nlm.nih.gov/Taxonomy/Browser/wwwtax.cgi?id=4890 [ascomycetes]] taxid 559292<br \> | ||
+ | [http://www.ncbi.nlm.nih.gov:80/entrez/query.fcgi?cmd=Retrieve&db=Protein&list_uids=6320147&dopt=GenPept ref|NP_010227.1|] Mbp1p [Saccharomyces cerevisiae S288c] [ 131] 1e-38<br \> | ||
+ | [http://www.ncbi.nlm.nih.gov:80/entrez/query.fcgi?cmd=Retrieve&db=Protein&list_uids=6320957&dopt=GenPept ref|NP_011036.1|] Swi4p [Saccharomyces cerevisiae S288c] [ 123] 1e-35<br \> | ||
+ | [http://www.ncbi.nlm.nih.gov:80/entrez/query.fcgi?cmd=Retrieve&db=Protein&list_uids=6322808&dopt=GenPept ref|NP_012881.1|] Phd1p [Saccharomyces cerevisiae S288c] [ 91] 1e-25<br \> | ||
+ | [http://www.ncbi.nlm.nih.gov:80/entrez/query.fcgi?cmd=Retrieve&db=Protein&list_uids=6323658&dopt=GenPept ref|NP_013729.1|] Sok2p [Saccharomyces cerevisiae S288c] [ 93] 3e-25<br \> | ||
+ | [http://www.ncbi.nlm.nih.gov:80/entrez/query.fcgi?cmd=Retrieve&db=Protein&list_uids=6322090&dopt=GenPept ref|NP_012165.1|] Xbp1p [Saccharomyces cerevisiae S288c] [ 40] 5e-07<br \> | ||
+ | </code> | ||
+ | |||
+ | [[Saccharomyces cerevisiae Xbp1|Xbp1]] is a special case. It has only very low coverage, but that is because it has a long domain insertion and the N-terminal match often is not recognized by alignment because the gap scores for long indels are unrealistically large. For now, I keep that sequence with the others. | ||
+ | |||
+ | |||
+ | Next we need to retrieve the sequences. Tedious to retrieve them one by one, but we can get them all at the same time: | ||
+ | |||
+ | |||
+ | {{task|1= | ||
+ | |||
+ | # Return to the BLAST results page and again open the '''Formatting options'''. | ||
+ | # Find the '''Limit results''' section and enter YFO's name into the field. For example <code>Saccharomyces cerevisiae [ORGN]</code> | ||
+ | # Click on '''Reformat''' | ||
+ | # Scroll to the '''Descriptions''' section, check the box at the left-hand margin, next to each sequence you want to keep. Then click on '''Download → FASTA complete sequence → Continue'''. | ||
+ | |||
+ | |||
+ | |||
+ | <div class="mw-collapsible mw-collapsed" data-expandtext="Expand" data-collapsetext="Collapse" style="border:#000000 solid 1px; padding: 10px; margin-left:25px; margin-right:25px;">There are actually several ways to download lists of sequences. Using the results page utility is only one. But if you know the GIs of the sequences you need, you can get them more directly by putting them into the URL... | ||
+ | <div class="mw-collapsible-content"> | ||
+ | |||
+ | * http://www.ncbi.nlm.nih.gov/protein/6320147,6320957,6322808,6323658,6322090?report=docsum - The default report | ||
+ | * http://www.ncbi.nlm.nih.gov/protein/6320147,6320957,6322808,6323658,6322090?report=fasta - FASTA sequences with NCBI HTML markup | ||
+ | |||
+ | Even more flexible is the [http://www.ncbi.nlm.nih.gov/books/NBK25500/#chapter1.Downloading_Full_Records '''eUtils'''] interface to the NCBI databases. For example you can download the dataset in text format by clicking below. | ||
+ | |||
+ | * http://eutils.ncbi.nlm.nih.gov/entrez/eutils/efetch.fcgi?db=protein&id=6320147,6320957,6322808,6323658,6322090&rettype=fasta&retmode=text | ||
+ | |||
+ | Note that this utility does not '''show''' anything, but downloads the (multi) fasta file to your default download directory. | ||
+ | |||
+ | </div> | ||
+ | </div> | ||
+ | }} | ||
+ | <!-- | ||
+ | |||
+ | Add to this assignment: | ||
+ | - study the BLAST output format, links, tools, scores ... | ||
+ | - compare the improvement in E-values to standard BLAST | ||
+ | - examine this in terms of sensitivity and specificity | ||
+ | |||
+ | --> | ||
Revision as of 14:28, 2 October 2015
Assignment for Week 4
Sequence alignment
< Assignment 3 | Assignment 5 > |
Note! This assignment is currently inactive. Major and minor unannounced changes may be made at any time.
Concepts and activities (and reading, if applicable) for this assignment will be topics on next week's quiz.
Contents
- 1 Introduction
- 2 The Mutation Data Matrix
- 3 The DNA binding site
- 4 R code: coloring the alignment by quality
- 5 Introduction
- 6 Defining the sequence to search with
- 7 Selecting species for a PSI-BLAST search
- 8 Executing the PSI-BLAST search
- 9 Links and resources
- 10 Footnotes and references
- 11 Ask, if things don't work for you!
Introduction
In this assignment we will perform an optimal global and local sequence alignment, and use R to plot the alignment quality as a colored bar-graph.
Optimal sequence alignments
Online programs for optimal sequence alignment are part of the EMBOSS tools. The programs take FASTA files as input.
- Local optimal SEQUENCE alignment "water"
Task:
- Retrieve the FASTA file for the YFO Mbp1 protein and for Saccharomyces cerevisiae.
- Save the files as text files to your computer, (if you haven't done so already). You could give them an extension of
.fa
. - Access the EMBOSS Explorer site (if you haven't done so yet, you might want to bookmark it.)
- Look for ALIGNMENT LOCAL, click on water, paste your FASTA sequences and run the program with default parameters.
- Study the results. You will probably find that the alignment extends over most of the protein, but does not include the termini.
- Considering the sequence identy cutoff we discussed in class (25% over the length of a domain), do you believe that the APSES domains are homologous?
- Change the Gap opening and Gap extension parameters to high values (e.g. 30 and 5). Then run the alignment again.
- Note what is different.
- You could try getting only an alignment for the ankyrin domains that you have found in the last assignment, by deleting the approximate region of the APSES domains from your input.
- Global optimal SEQUENCE alignment "needle"
Task:
- Look for ALIGNMENT GLOBAL, click on needle, paste your FASTA sequences and run the program with default parameters.
- Study the results. You will find that the alignment extends over the entire protein, likely with long indels at the termini.
- Change the Output alignment format to FASTA pairwise simple, to retrieve the aligned FASTA files with indels.
- Copy the aligned sequences (with indels) and save them to your computer. You could give them an extension of
.fal
to remind you that they are aligned FASTA sequences.
The Mutation Data Matrix
The NCBI makes its alignment matrices available by ftp. They are located at ftp://ftp.ncbi.nih.gov/blast/matrices - for example here is a link to the BLOSUM62 matrix[1]. Access that site and download the BLOSUM62
matrix to your computer. You could give it a filename of BLOSUM62.mdm
.
It should look like this.
# Matrix made by matblas from blosum62.iij
# * column uses minimum score
# BLOSUM Clustered Scoring Matrix in 1/2 Bit Units
# Blocks Database = /data/blocks_5.0/blocks.dat
# Cluster Percentage: >= 62
# Entropy = 0.6979, Expected = -0.5209
A R N D C Q E G H I L K M F P S T W Y V B Z X *
A 4 -1 -2 -2 0 -1 -1 0 -2 -1 -1 -1 -1 -2 -1 1 0 -3 -2 0 -2 -1 0 -4
R -1 5 0 -2 -3 1 0 -2 0 -3 -2 2 -1 -3 -2 -1 -1 -3 -2 -3 -1 0 -1 -4
N -2 0 6 1 -3 0 0 0 1 -3 -3 0 -2 -3 -2 1 0 -4 -2 -3 3 0 -1 -4
D -2 -2 1 6 -3 0 2 -1 -1 -3 -4 -1 -3 -3 -1 0 -1 -4 -3 -3 4 1 -1 -4
C 0 -3 -3 -3 9 -3 -4 -3 -3 -1 -1 -3 -1 -2 -3 -1 -1 -2 -2 -1 -3 -3 -2 -4
Q -1 1 0 0 -3 5 2 -2 0 -3 -2 1 0 -3 -1 0 -1 -2 -1 -2 0 3 -1 -4
E -1 0 0 2 -4 2 5 -2 0 -3 -3 1 -2 -3 -1 0 -1 -3 -2 -2 1 4 -1 -4
G 0 -2 0 -1 -3 -2 -2 6 -2 -4 -4 -2 -3 -3 -2 0 -2 -2 -3 -3 -1 -2 -1 -4
H -2 0 1 -1 -3 0 0 -2 8 -3 -3 -1 -2 -1 -2 -1 -2 -2 2 -3 0 0 -1 -4
I -1 -3 -3 -3 -1 -3 -3 -4 -3 4 2 -3 1 0 -3 -2 -1 -3 -1 3 -3 -3 -1 -4
L -1 -2 -3 -4 -1 -2 -3 -4 -3 2 4 -2 2 0 -3 -2 -1 -2 -1 1 -4 -3 -1 -4
K -1 2 0 -1 -3 1 1 -2 -1 -3 -2 5 -1 -3 -1 0 -1 -3 -2 -2 0 1 -1 -4
M -1 -1 -2 -3 -1 0 -2 -3 -2 1 2 -1 5 0 -2 -1 -1 -1 -1 1 -3 -1 -1 -4
F -2 -3 -3 -3 -2 -3 -3 -3 -1 0 0 -3 0 6 -4 -2 -2 1 3 -1 -3 -3 -1 -4
P -1 -2 -2 -1 -3 -1 -1 -2 -2 -3 -3 -1 -2 -4 7 -1 -1 -4 -3 -2 -2 -1 -2 -4
S 1 -1 1 0 -1 0 0 0 -1 -2 -2 0 -1 -2 -1 4 1 -3 -2 -2 0 0 0 -4
T 0 -1 0 -1 -1 -1 -1 -2 -2 -1 -1 -1 -1 -2 -1 1 5 -2 -2 0 -1 -1 0 -4
W -3 -3 -4 -4 -2 -2 -3 -2 -2 -3 -2 -3 -1 1 -4 -3 -2 11 2 -3 -4 -3 -2 -4
Y -2 -2 -2 -3 -2 -1 -2 -3 2 -1 -1 -2 -1 3 -3 -2 -2 2 7 -1 -3 -2 -1 -4
V 0 -3 -3 -3 -1 -2 -2 -3 -3 3 1 -2 1 -1 -2 -2 0 -3 -1 4 -3 -2 -1 -4
B -2 -1 3 4 -3 0 1 -1 0 -3 -4 0 -3 -3 -2 0 -1 -4 -3 -3 4 1 -1 -4
Z -1 0 0 1 -3 3 4 -2 0 -3 -3 1 -1 -3 -1 0 -1 -3 -2 -2 1 4 -1 -4
X 0 -1 -1 -1 -2 -1 -1 -1 -1 -1 -1 -1 -1 -1 -2 0 0 -2 -1 -1 -1 -1 -1 -4
* -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 -4 1
Task:
- Study this and make sure you understand what this table is, how it can be used, and what a reasonable range of values for identities and pairscores for non-identical, similar and dissimilar residues is. Ask on the mailing list in case you have questions.
The DNA binding site
Now, that you know how YFO Mbp1 aligns with yeast Mbp1, you can evaluate functional conservation in these homologous proteins. You probably already downloaded the two Biochemistry papers by Taylor et al. (2000) and by Deleeuw et al. (2008) that we encountered in Assignment 2. These discuss the residues involved in DNA binding[2]. In particular the residues between 50-74 have been proposed to comprise the DNA recognition domain.
Task:
- Using the APSES domain alignment you have just constructed, find the YFO Mbp1 residues that correspond to the range 50-74 in yeast.
- Note whether the sequences are especially highly conserved in this region.
- Using Chimera, look at the region. Use the sequence window to make sure that the sequence numbering between the paper and the PDB file are the same (they are often not identical!). Then select the residues - the proposed recognition domain - and color them differently for emphasis. Study this in stereo to get a sense of the spatial relationships. Check where the conserved residues are.
- A good representation is stick - but other representations that include sidechains will also serve well.
- Calculate a solvent accessible surface of the protein in a separate representation and make it transparent.
- You could combine three representations: (1) the backbone (in ribbon view), (2) the sidechains of residues that presumably contact DNA, distinctly colored, and (3) a transparent surface of the entire protein. This image should show whether residues annotated as DNA binding form a contiguous binding interface.
DNA binding interfaces are expected to comprise a number of positively charged amino acids, that might form salt-bridges with the phosphate backbone.
Task:
- Study and consider whether this is the case here and which residues might be included.
R code: coloring the alignment by quality
Task:
- Study this code carefully, execute it, section by section and make sure you understand all of it. Ask on the list if anything is not clear.
# BiostringsExample.R
# Short tutorial on sequence alignment with the Biostrings package.
# Boris Steipe for BCH441, 2013 - 2014
#
setwd("~/path/to/your/R_files/")
setwd("~/Documents/07.TEACHING/37-BCH441 Bioinformatics 2014/05-Materials/Assignment_5 data")
# Biostrings is a package within the bioconductor project.
# bioconducter packages have their own installation system,
# they are normally not installed via CRAN.
# First, you load the BioConductor installer...
source("http://bioconductor.org/biocLite.R")
# Then you can install the Biostrings package and all of its dependencies.
biocLite("Biostrings")
# ... and load the library.
library(Biostrings)
# Some basic (technical) information is available ...
library(help=Biostrings)
# ... but for more in depth documentation, use the
# so called "vignettes" that are provided with every R package.
browseVignettes("Biostrings")
# In this code, we mostly use functions that are discussed in the
# pairwise alignement vignette.
# Read in two fasta files - you will need to edit this for YFO
sacce <- readAAStringSet("mbp1-sacce.fa", format="fasta")
# "USTMA" is used only as an example here - modify for YFO :-)
ustma <- readAAStringSet("mbp1-ustma.fa", format="fasta")
sacce
names(sacce)
names(sacce) <- "Mbp1 SACCE"
names(ustma) <- "Mbp1 USTMA" # Example only ... modify for YFO
width(sacce)
as.character(sacce)
# Biostrings takes a sophisticated approach to sequence alignment ...
?pairwiseAlignment
# ... but the use in practice is quite simple:
ali <- pairwiseAlignment(sacce, ustma, substitutionMatrix = "BLOSUM50")
ali
pattern(ali)
subject(ali)
writePairwiseAlignments(ali)
p <- aligned(pattern(ali))
names(p) <- "Mbp1 SACCE aligned"
s <- aligned(subject(ali))
names(s) <- "Mbp1 USTMA aligned"
# don't overwrite your EMBOSS .fal files
writeXStringSet(p, "mbp1-sacce.R.fal", append=FALSE, format="fasta")
writeXStringSet(s, "mbp1-ustma.R.fal", append=FALSE, format="fasta")
# Done.
- Compare the alignments you received from the EMBOSS server, and that you co puted using R. Are they aproximately the same? Exactly? You did use different matrices and gap aameters, so minor differences are to be expected. But by and large you should get the same alignments.
We will now use the aligned sequences to compute a graphical display of alignment quality.
Task:
- Study this code carefully, execute it, section by section and make sure you understand all of it. Ask on the list if anything is not clear.
# aliScore.R
# Evaluating an alignment with a sliding window score
# Boris Steipe, October 2012. Update October 2013
setwd("~/path/to/your/R_files/")
# Scoring matrices can be found at the NCBI.
# ftp://ftp.ncbi.nih.gov/blast/matrices/BLOSUM62
# It is good practice to set variables you might want to change
# in a header block so you don't need to hunt all over the code
# for strings you need to update.
#
fa1 <- "mbp1-sacce.R.fal"
fa2 <- "mbp1-ustma.R.fal"
code1 <- "SACCE"
code2 <- "USTMA"
mdmFile <- "BLOSUM62.mdm"
window <- 9 # window-size (should be an odd integer)
# ================================================
# Read data files
# ================================================
# read fasta datafiles using seqinr function read.fasta()
install.packages("seqinr")
library(seqinr)
tmp <- unlist(read.fasta(fa1, seqtype="AA", as.string=FALSE, seqonly=TRUE))
seq1 <- unlist(strsplit(as.character(tmp), split=""))
tmp <- unlist(read.fasta(fa2, seqtype="AA", as.string=FALSE, seqonly=TRUE))
seq2 <- unlist(strsplit(as.character(tmp), split=""))
if (length(seq1) != length(seq2)) {
print("Error: Sequences have unequal length!")
}
lSeq <- length(seq1)
# ================================================
# Read scoring matrix
# ================================================
MDM <- read.table(mdmFile, skip=6)
# This is a dataframe. Study how it can be accessed:
MDM
MDM[1,]
MDM[,1]
MDM[5,5] # Cys-Cys
MDM[20,20] # Val-Val
MDM[,"W"] # the tryptophan column
MDM["R","W"] # Arg-Trp pairscore
MDM["W","R"] # Trp-Arg pairscore: pairscores are symmetric
colnames(MDM) # names of columns
rownames(MDM) # names of rows
colnames(MDM)[3] # third column
rownames(MDM)[12] # twelfth row
# change the two "*" names to "-" so we can use them to score
# indels of the alignment. This is a bit of a hack, since this
# does not reflect the actual indel penalties (which is, as you)
# remember from your lectures, calculated as a gap opening
# + gap extension penalty; it can't be calculated in a pairwise
# manner) EMBOSS defaults for BLODSUM62 are opening -10 and
# extension -0.5 i.e. a gap of size 3 (-11.5) has approximately
# the same penalty as a 3-character score of "-" matches (-12)
# so a pairscore of -4 is not entirely unreasonable.
colnames(MDM)[24]
rownames(MDM)[24]
colnames(MDM)[24] <- "-"
rownames(MDM)[24] <- "-"
colnames(MDM)[24]
rownames(MDM)[24]
MDM["Q", "-"]
MDM["-", "D"]
# so far so good.
# ================================================
# Tabulate pairscores for alignment
# ================================================
# It is trivial to create a pairscore vector along the
# length of the aligned sequences.
PS <- vector()
for (i in 1:lSeq) {
aa1 <- seq1[i]
aa2 <- seq2[i]
PS[i] = MDM[aa1, aa2]
}
PS
# The same vector could be created - albeit perhaps not so
# easy to understand - with the expression ...
MDM[cbind(seq1,seq2)]
# ================================================
# Calculate moving averages
# ================================================
# In order to evaluate the alignment, we will calculate a
# sliding window average over the pairscores. Somewhat surprisingly
# R doesn't (yet) have a native function for moving averages: options
# that are quoted are:
# - rollmean() in the "zoo" package http://rss.acs.unt.edu/Rdoc/library/zoo/html/rollmean.html
# - MovingAverages() in "TTR" http://rss.acs.unt.edu/Rdoc/library/TTR/html/MovingAverages.html
# - ma() in "forecast" http://robjhyndman.com/software/forecast/
# But since this is easy to code, we shall implement it ourselves.
PSma <- vector() # will hold the averages
winS <- floor(window/2) # span of elements above/below the centre
winC <- winS+1 # centre of the window
# extend the vector PS with zeros (virtual observations) above and below
PS <- c(rep(0, winS), PS , rep(0, winS))
# initialize the window score for the first position
winScore <- sum(PS[1:window])
# write the first score to PSma
PSma[1] <- winScore
# Slide the window along the sequence, and recalculate sum()
# Loop from the next position, to the last position that does not exceed the vector...
for (i in (winC + 1):(lSeq + winS)) {
# subtract the value that has just dropped out of the window
winScore <- winScore - PS[(i-winS-1)]
# add the value that has just entered the window
winScore <- winScore + PS[(i+winS)]
# put score into PSma
PSma[i-winS] <- winScore
}
# convert the sums to averages
PSma <- PSma / window
# have a quick look at the score distributions
boxplot(PSma)
hist(PSma)
# ================================================
# Plot the alignment scores
# ================================================
# normalize the scores
PSma <- (PSma-min(PSma))/(max(PSma) - min(PSma) + 0.0001)
# spread the normalized values to a desired range, n
nCol <- 10
PSma <- floor(PSma * nCol) + 1
# Assign a colorspectrum to a vector (with a bit of colormagic,
# don't worry about that for now). Dark colors are poor scores,
# "hot" colors are high scores
spect <- colorRampPalette(c("black", "red", "yellow", "white"), bias=0.4)(nCol)
# Color is an often abused aspect of plotting. One can use color to label
# *quantities* or *qualities*. For the most part, our pairscores measure amino
# acid similarity. That is a quantity and with the spectrum that we just defined
# we associte the measured quantities with the color of a glowing piece
# of metal: we start with black #000000, then first we ramp up the red
# (i.e. low-energy) part of the visible spectrum to red #FF0000, then we
# add and ramp up the green spectrum giving us yellow #FFFF00 and finally we
# add blue, giving us white #FFFFFF. Let's have a look at the spectrum:
s <- rep(1, nCol)
barplot(s, col=spect, axes=F, main="Color spectrum")
# But one aspect of our data is not quantitatively different: indels.
# We valued indels with pairscores of -4. But indels are not simply poor alignment,
# rather they are non-alignment. This means stretches of -4 values are really
# *qualitatively* different. Let's color them differently by changing the lowest
# level of the spectrum to grey.
spect[1] <- "#CCCCCC"
barplot(s, col=spect, axes=F, main="Color spectrum")
# Now we can display our alignment score vector with colored rectangles.
# Convert the integers in PSma to color values from spect
PScol <- vector()
for (i in 1:length(PSma)) {
PScol[i] <- spect[ PSma[i] ] # this is how a value from PSma is used as an index of spect
}
# Plot the scores. The code is similar to the last assignment.
# Create an empty plot window of appropriate size
plot(1,1, xlim=c(-100, lSeq), ylim=c(0, 2) , type="n", yaxt="n", bty="n", xlab="position in alignment", ylab="")
# Add a label to the left
text (-30, 1, adj=1, labels=c(paste("Mbp1:\n", code1, "\nvs.\n", code2)), cex=0.9 )
# Loop over the vector and draw boxes without border, filled with color.
for (i in 1:lSeq) {
rect(i, 0.9, i+1, 1.1, border=NA, col=PScol[i])
}
# Note that the numbers along the X-axis are not sequence numbers, but numbers
# of the alignment, i.e. sequence number + indel length. That is important to
# realize: if you would like to add the annotations from the last assignment
# which I will leave as an exercise, you need to map your sequence numbering
# into alignment numbering. Let me know in case you try that but need some help.
- That is all.
Introduction
- Take care of things, and they will take care of you.
- Shunryu Suzuki
Anyone can click buttons on a Web page, but to use the powerful sequence database search tools right often takes considerable more care, caution and consideration.
Much of what we know about a protein's physiological function is based on the conservation of that function as the species evolves. We assess conservation by comparing sequences between related proteins. Conservation - or its opposite: variation - is a consequence of selection under constraints: protein sequences change as a consequence of DNA mutations, this changes the protein's structure, this in turn changes functions and that has the multiple effects on a species' fitness function. Detrimental variants may be removed. Variation that is tolerated is largely neutral and therefore found only in positions that are neither structurally nor functionally critical. Conservation patterns can thus provide evidence for many different questions: structural conservation among proteins with similar 3D-structures, functional conservation among homologues with comparable roles, or amino acid propensities as predictors for protein engineering and design tasks.
Measuring conservation requires alignment. Therefore a carefully done multiple sequence alignment (MSA) is a cornerstone for the annotation of the essential properties a gene or protein. MSAs are also useful to resolve ambiguities in the precise placement of indels and to ensure that columns in alignments actually contain amino acids that evolve in a similar context. MSAs serve as input for
- functional annotation;
- protein homology modeling;
- phylogenetic analyses, and
- sensitive homology searches in databases.
In order to perform a multiple sequence alignment, we obviously need a set of homologous sequences. This is where the trouble begins. All interpretation of MSA results depends absolutely on how the input sequences were chosen. Should we include only orthologs, or paralogs as well? Should we include only species with fully sequenced genomes, or can we tolerate that some orthologous genes are possibly missing for a species? Should we include all sequences we can lay our hands on, or should we restrict the selection to a manageable number of representative sequences? All of these choices influence our interpretation:
- orthologs are expected to be functionally and structurally conserved;
- paralogs may have divergent function but have similar structure;
- missing genes may make paralogs look like orthologs; and
- selection bias may weight our results toward sequences that are over-represented and do not provide a fair representation of evolutionary divergence.
In this assignment, we will set ourselves the task to use PSI-BLAST and find all orthologs and paralogs of the APSES domain containing transcription factors in YFO. We will use these sequences later for multiple alignments, calculation of conservation etc. The methodical problem we will address is: how do we perform a sensitive PSI-BLAST search in one organism. There is an issue to consider:
- If we restrict the PSI-BLAST search to YFO, PSI-BLAST has little chance of building a meaningful profile - the number of homologues that actually are in YFO is too small. Thus the search will not become very sensitive.
- If we don't restrict our search, but search in all species, the number of hits may become too large. It becomes increasingly difficult to closely check all hits as to whether they have good coverage, and how will we evaluate the fringe cases of marginal E-value, where we need to decide whether to include a new sequence in the profile, or whether to hold off on it for one or two iterations, to see whether the E-value drops significantly. Profile corruption would make the search useless. This is maybe still manageable if we restrict our search to fungi, but imagine you are working with a bacterial protein, or a protein that is conserved across the entire tree of life: your search will find thousands of sequences. And by next year, thousands more will have been added.
Therefore we have to find a middle ground: add enough species (sequences) to compile a sensitive profile, but not so many that we can no longer individually assess the sequences that contribute to the profile.
Thus in practice, a sensitive PSI-BLAST search needs to address two issues before we begin:
- We need to define the sequence we are searching with; and
- We need to define the dataset we are searching in.
Defining the sequence to search with
Consider again the task we set out from: find all orthologs and paralogs of the APSES domain containing transcription factors in YFO.
Task:
What query sequence should you use? Should you ...
- Search with the full-length Mbp1 sequence from Saccharomyces cerevisiae?
- Search with the full-length Mbp1 homolog that you found in YFO?
- Search with the structurally defined S. cerevisiae APSES domain sequence?
- Search with the APSES domain sequence from the YFO homolog, that you have defined by sequence alignment with the yeast protein?
- Search with the KilA-N domain sequence?
- The full-length Mbp1 sequence from Saccharomyces cerevisiae
- Since this sequence contains multiple domains (in particular the ubiquitous Ankyrin domains) it is not suitable for BLAST database searches. You must restrict your search to the domain of greatest interest for your question. That would be the APSES domain.
- The full-length Mbp1 homolog that you found in YFO
- What organism the search sequence comes from does not make a difference. Since you aim to find all homologs in YFO, it is not necessary to have your search sequence more or less similar to any particular homologs. In fact any APSES sequence should give you the same result, since they are all homologous. But the full-length sequence in YFO has the same problem as the Saccharomyces sequence.
- The structurally defined S. cerevisiae APSES domain sequence?
- That would be my first choice, just because it is structurally well defined as a complete domain, and the sequence is easy to obtain from the
1BM8
PDB entry. (1MB1
would also work, but you would need to edit out the penta-Histidine tag at the C-terminus that was engineered into the sequence to help purify the recombinantly expressed protein.)
- The APSES domain sequence from the YFO homolog, that you have defined by sequence alignment with the yeast protein?
- As argued above: since they are all homologs, any of them should lead to the same set of results.
- The KilA-N domain sequence?
- This is a shorter sequence and a more distant homolog to the domain we are interested in. It would not be my first choice: the fact that it is more distantly related might make the search more sensitive. The fact that it is shorter might make the search less specific. The effect of this tradeoff would need to be compared and considered. By the way: the same holds for the even shorter subdomain 50-74 we discussed in the last assignment. However: one of the results of our analysis will be whether APSES domains in fungi all have the same length as the Mbp1 domain, or whether some are indeed much shorter, as suggested by the Pfam alignment.
So in my opinion, you should search with the yeast Mbp1 APSES domain, i.e. the sequence which you have previously studied in the crystal structure. Where is that? Well, you might have saved it in your journal, or you can get it again from the PDB (i.e. here, or from Assignment 3.
Selecting species for a PSI-BLAST search
As discussed in the introduction, in order to use our sequence set for studying structural and functional features and conservation patterns of our APSES domain proteins, we should start with a well selected dataset of APSES domain containing homologs in YFO. Since these may be quite divergent, we can't rely on BLAST to find all of them, we need to use the much more sensitive search of PSI-BLAST instead. But even though you are interested only in YFO's genes, it would be a mistake to restrict the PSI-BLAST search to YFO. PSI-BLAST becomes more sensitive if the profile represents more diverged homologs. Therefore we should always search with a broadly representative set of species, even if we are interested only in the results for one of the species. This is important. Please reflect on this for a bit and make sure you understand the rationale why we include sequences in the search that we are not actually interested in.
But you can also search with too many species: if the number of species is large and PSI-BLAST finds a large number of results:
- it becomes unwieldy to check the newly included sequences at each iteration, inclusion of false-positive hits may result, profile corruption and loss of specificity. The search will fail.
- since genomes from some parts of the Tree Of Life are over represented, the inclusion of all sequences leads to selection bias and loss of sensitivity.
We should therefore try to find a subset of species
- that represent as large a range as possible on the evolutionary tree;
- that are as well distributed as possible on the tree; and
- whose genomes are fully sequenced.
These criteria are important. Again, reflect on them and understand their justification. Choosing your species well for a PSI-BLAST search can be crucial to obtain results that are robust and meaningful.
How can we define a list of such species, and how can we use the list?
The definition is a rather typical bioinformatics task for integrating datasources: "retrieve a list of representative fungi with fully sequenced genomes". Unfortunately, to do this in a principled way requires tools that you can't (yet) program: we would need to use a list of genome sequenced fungi, estimate their evolutionary distance and select a well-distributed sample. Regrettably you can't combine such information easily with the resources available from the NCBI.
We will use an approach that is conceptually similar: selecting a set of species according to their shared taxonomic rank in the tree of life. Biological classification provides a hierarchical system that describes evolutionary relatedness for all living entities. The levels of this hierarchy are so called taxonomic ranks. These ranks are defined in Codes of Nomenclature that are curated by the self-governed international associations of scientists working in the field. The number of ranks is not specified: there is a general consensus on seven principal ranks (see below, in bold) but many subcategories exist and may be newly introduced. It is desired–but not mandated–that ranks represent clades (a group of related species, or a "branch" of a phylogeny), and it is desired–but not madated–that the rank is sharply defined. The system is based on subjective dissimilarity. Needless to say that it is in flux.
If we follow a link to an entry in the NCBI's Taxonomy database, eg. Saccharomyces cerevisiae S228c, the strain from which the original "yeast genome" was sequenced in the late 1990s, we see the following specification of its taxonomic lineage:
cellular organisms; Eukaryota; Opisthokonta; Fungi; Dikarya;
Ascomycota; Saccharomyceta; Saccharomycotina; Saccharomycetes;
Saccharomycetales; Saccharomycetaceae; Saccharomyces; Saccharomyces cerevisiae
These names can be mapped into taxonomic ranks ranks, since the suffixes of these names e.g. -mycotina, -mycetaceae are specific to defined ranks. (NCBI does not provide this mapping, but Wikipedia is helpful here.)
Rank | Suffix | Example |
Domain | Eukaryota (Eukarya) | |
Subdomain | Opisthokonta | |
Kingdom | Fungi | |
Subkingdom | Dikarya | |
Phylum | Ascomycota | |
rankless taxon[3] | -myceta | Saccharomyceta |
Subphylum | -mycotina | Saccharomycotina |
Class | -mycetes | Saccharomycetes |
Subclass | -mycetidae | |
Order | -ales | Saccharomycetales |
Family | -aceae | Saccharomycetaceae |
Subfamily | -oideae | |
Tribe | -eae | |
Subtribe | -ineae | |
Genus | Saccharomyces | |
Species | Saccharomyces cerevisiae |
- Capnodiales Zymoseptoria tritici
- Erysiphales Blumeria graminis
- Eurotiales Aspergillus nidulans
- Glomerellales Glomerella graminicola
- Hypocreales Trichoderma reesei
- Magnaporthales Magnaporthe oryzae
- Microbotryales Microbotryum violaceum
- Pezizales Tuber melanosporum
- Pleosporales Phaeosphaeria nodorum
- Pucciniales Puccinia graminis
- Saccharomycetales Saccharomyces cerevisiae
- Schizosaccharomycetales Schizosaccharomyces pombe
- Sclerotiniaceae Sclerotinia sclerotiorum
- Sordariales Neurospora crassa
- Tremellales Cryptococcus neoformans
- Ustilaginales Ustilago maydis
Aspergillus nidulans[orgn]
OR Blumeria graminis[orgn]
OR Cryptococcus neoformans[orgn]
OR Glomerella graminicola[orgn]
OR Magnaporthe oryzae[orgn]
OR Microbotryum violaceum[orgn]
OR Neurospora crassa[orgn]
OR Phaeosphaeria nodorum[orgn]
OR Puccinia graminis[orgn]
OR Sclerotinia sclerotiorum[orgn]
OR Trichoderma reesei[orgn]
OR Tuber melanosporum[orgn]
OR Saccharomyces cerevisiae[orgn]
OR Schizosaccharomyces pombe[orgn]
OR Ustilago maydis[orgn]
OR Zymoseptoria tritici[orgn]
Executing the PSI-BLAST search
We have a list of species. Good. Next up: how do we use it.
Task:
- Navigate to the BLAST homepage.
- Select protein BLAST.
- Paste the APSES domain sequence into the search field.
- Select refseq as the database.
- Copy the organism restriction list from above and enter the correct name for YFO into the list if it is not there already. Obviously, you can't find sequences in YFO if YFO is not included in your search space. Paste the list into the Entrez Query field.
- In the Algorithm section, select PSI-BLAST.
- Click on BLAST.
Evaluate the results carefully. Since we used default parameters, the threshold for inclusion was set at an E-value of 0.005 by default, and that may be a bit too lenient. If you look at the table of your hits– in the Sequences producing significant alignments... section– there may also be a few sequences that have a low query coverage of less than 80%. Let's exclude these from the profile initially: not to worry, if they are true positives, the will come back with improved E-values and greater coverage in subsequent iterations. But if they were false positives, their E-values will rise and they should drop out of the profile and not contaminate it.
Task:
- In the header section, click on Formatting options and in the line "Format for..." set the with inclusion threshold to
0.001
(This means E-values can't be above 10-03 for the sequence to be included.) - Click on the Reformat button (top right).
- In the table of sequence descriptions (not alignments!), click on the Query coverage to sort the table by coverage, not by score.
- Copy the rows with a coverage of less than 80% and paste them into some text editor so you can compare what happens with these sequences in the next iteration.
- Deselect the check mark next to these sequences in the right-hand column Select for PSI blast. (For me these are six sequences, but with YFO included that may be a bit different.)
- Then scroll to Run PSI-BLAST iteration 2 ... and click on
Go
.
This is now the "real" PSI-BLAST at work: it constructs a profile from all the full-length sequences and searches with the profile, not with any individual sequence. Note that we are controlling what goes into the profile in two ways:
- we are explicitly removing sequences with poor coverage; and
- we are requiring a more stringent minimum E-value for each sequence.
Task:
- Again, study the table of hits. Sequences highlighted in yellow have met the search criteria in the second iteration. Note that the coverage of (some) of the previously excluded sequences is now above 80%.
- Let's exclude partial matches one more time. Again, deselect all sequences with less than 80% coverage. Then run the third iteration.
- Iterate the search in this way until no more "New" sequences are added to the profile. Then scan the list of excluded hits ... are there any from YFO that seem like they could potentially make the list? Marginal E-value perhaps, or reasonable E-value but less coverage? If that's the case, try returning the E-value threshold to the default 0.005 and see what happens...
Once no "new" sequences have been added, if we were to repeat the process again and again, we would always get the same result because the profile stays the same. We say that the search has converged. Good. Time to harvest.
Task:
- At the header, click on Taxonomy reports and find YFO in the Organism Report section. These are your APSES domain homologs. All of them. Actually, perhaps more than all: the report may also include sequences with E-values above the inclusion threshold.
- From the report copy the sequence identifiers
- from YFO,
- with E-values above your defined threshold.
For example, the list of Saccharomyces genes is the following:
Saccharomyces cerevisiae S288c [ascomycetes] taxid 559292
ref|NP_010227.1| Mbp1p [Saccharomyces cerevisiae S288c] [ 131] 1e-38
ref|NP_011036.1| Swi4p [Saccharomyces cerevisiae S288c] [ 123] 1e-35
ref|NP_012881.1| Phd1p [Saccharomyces cerevisiae S288c] [ 91] 1e-25
ref|NP_013729.1| Sok2p [Saccharomyces cerevisiae S288c] [ 93] 3e-25
ref|NP_012165.1| Xbp1p [Saccharomyces cerevisiae S288c] [ 40] 5e-07
Xbp1 is a special case. It has only very low coverage, but that is because it has a long domain insertion and the N-terminal match often is not recognized by alignment because the gap scores for long indels are unrealistically large. For now, I keep that sequence with the others.
Next we need to retrieve the sequences. Tedious to retrieve them one by one, but we can get them all at the same time:
Task:
- Return to the BLAST results page and again open the Formatting options.
- Find the Limit results section and enter YFO's name into the field. For example
Saccharomyces cerevisiae [ORGN]
- Click on Reformat
- Scroll to the Descriptions section, check the box at the left-hand margin, next to each sequence you want to keep. Then click on Download → FASTA complete sequence → Continue.
- http://www.ncbi.nlm.nih.gov/protein/6320147,6320957,6322808,6323658,6322090?report=docsum - The default report
- http://www.ncbi.nlm.nih.gov/protein/6320147,6320957,6322808,6323658,6322090?report=fasta - FASTA sequences with NCBI HTML markup
Even more flexible is the eUtils interface to the NCBI databases. For example you can download the dataset in text format by clicking below.
Note that this utility does not show anything, but downloads the (multi) fasta file to your default download directory.
- That is all.
Links and resources
Footnotes and references
- ↑ The directory also contains sourcecode to generte the PAM matrices. This may be of interest for you if you ever want to produce scoring matrices from your own datasets.
- ↑ (Taylor et al. (2000) Biochemistry 39: 3943-3954 and Deleeuw et al. (2008) Biochemistry. 47:6378-6385)
- ↑ The -myceta are well supported groups above the Class rank. See Leotiomyceta for details and references.
Ask, if things don't work for you!
- If anything about the assignment is not clear to you, please ask on the mailing list. You can be certain that others will have had similar problems. Success comes from joining the conversation.
- Do consider how to ask your questions so that a meaningful answer is possible:
- How to create a Minimal, Complete, and Verifiable example on stackoverflow and ...
- How to make a great R reproducible example are required reading.
< Assignment 3 | Assignment 5 > |