# On Hill et al's conjecture for calculating the subtree prune and regraft distance between phylogenies

- Simone Linz
^{1}Email author

**10**:334

**DOI: **10.1186/1471-2148-10-334

© Linz; licensee BioMed Central Ltd. 2010

**Received: **21 June 2010

**Accepted: **29 October 2010

**Published: **29 October 2010

## Abstract

### Background

Recently, Hill et al. [1] implemented a new software package--called SPRIT--which aims at calculating the minimum number of horizontal gene transfer events that is needed to simultaneously explain the evolution of two rooted binary phylogenetic trees on the same set of taxa. To this end, SPRIT computes the closely related so-called rooted subtree prune and regraft distance between two phylogenies. However, calculating this distance is an NP-hard problem and exact algorithms are often only applicable to small- or medium-sized problem instances. Trying to overcome this problem, Hill et al. propose a divide-and-conquer approach to speed up their algorithm and conjecture that this approach can be used to compute the rooted subtree prune and regraft distance exactly.

### Results

In this note, we present a counterexample to Hill et al's conjecture and subsequently show that a modified version of their conjecture holds.

### Conclusion

While Hill et al's conjecture may result in an overestimate of the rooted subtree prune and regraft distance, a slightly more restricted version of their approach gives the desired outcome and can be applied to speed up the exact calculation of this distance between two phylogenies.

## Background

In recent years, one of the main research foci in the development of theoretical frameworks that aim at approaching questions in evolutionary biology turns from the reconstruction of phylogenetic trees towards the reconstruction of phylogenetic networks. This has partly been triggered by the exponentially growing amount of available sequence data arising from whole genome sequencing projects and a successive detection of genes whose sequences are chimeras of distinct ancestral gene sequences, and hence, are likely to be the result of reticulation (e.g. horizontal gene transfer or hybridization). Although evolutionary biologists are now mostly acknowledging the existence of species arising from reticulation within certain groups of organisms, the extent to which such events have influenced the evolutionary history for a set of present-day species remains controversially discussed until today. To shed light on this question, Hill et al. [1] recently published a study that is centered around the identification and quantification of horizontal gene transfer. The authors have implemented a new software package--called SPRIT--consisting of a heuristic as well as an exact algorithm, applied it to several data sets of variable size, and compared their results and running times with those obtained from other algorithms that have previously been developed to analyze reticulate evolution.

Algorithmically, SPRIT draws on ideas that are borrowed from work that has been done in the context of the graph-theoretic operation of rooted subtree prune and regraft (rSPR) which is a popular tool to quantify the dissimilarity between two trees. Loosely speaking, an rSPR operation cuts (prunes) a subtree and reattaches (regrafts) it to another part of the tree. A lower bound on the number of reticulation events that is needed to simultaneously explain two phylogenies is the minimum number of rSPR operations that transform one phylogeny into the other [2, 3]. This minimum number, which is computed by SPRIT, is referred to as the rSPR distance. However, since the task of calculating this distance is an NP-hard optimization problem, the application of exact algorithms is often restricted to medium-sized data sets.

In trying to overcome this obstacle, thus to speed up SPRIT, Hill et al. propose a divide-and-conquer-type reduction that breaks the problem into several smaller and more tractable subproblems before calculating the rSPR distance for each subproblem separately. Briefly, the authors conjecture that the sum of rSPR distances over all smaller subproblems is equal to the rSPR distance of the original unreduced trees. In this note, we give a counterexample to their conjecture. Nevertheless, we subsequently show that a slightly more restricted version of their conjecture holds and can be used to exactly calculate the rSPR distance between two phylogenies by breaking the problem into smaller subproblems.

The remainder of this paper is organized as follows. The next section contains some mathematical preliminaries that are needed to formally state Hill at al's conjecture. This conjecture is then given in the subsequent section which also contains the aforementioned counterexample. We then show that a modified version of the conjecture holds in the following section. We end this note with a brief conclusion.

## Preliminaries

In this section, we give some preliminary definitions that are used throughout this paper. Unless otherwise stated, the notation and terminology follows [4].

### Phylogenetic Trees

A *rooted binary phylogenetic X-tree* $\mathcal{T}$ is a rooted tree whose root has degree two while all other interior vertices have degree three and whose leaf set is *X* . The set *X* is the *label set* of $\mathcal{T}$ and is frequently denoted by $\mathcal{L}(\mathcal{T})$. Furthermore, let *X*′ be a subset of *X*. The *minimal rooted subtree* of $\mathcal{T}$ that connects all the leaves in *X*′ is denoted by $\mathcal{T}$(*X*′) while the *restriction of* $\mathcal{T}$*to X*′, denoted by $\mathcal{T}$|*X*′, is the rooted binary phylogenetic *X*′-tree obtained from $\mathcal{T}$(*X*′) by contracting all degree-two vertices apart from the root.

### Rooted Subtree Prune and Regraft

Let $\mathcal{T}$ be a rooted binary phylogenetic *X*-trees. For the purposes of the upcoming definition, we view the root of $\mathcal{T}$ as a vertex *ρ* adjoined to the original root by a pendant edge. Now, let *e* = {*u*, *v*} be any edge of $\mathcal{T}$ that is not incident with *ρ* such that *u* is the vertex on the path from *ρ* to $v$. Let ${\mathcal{T}}^{\prime}$ be the rooted binary phylogenetic *X*-tree obtained from $\mathcal{T}$ by deleting *e* and reattaching the resulting subtree with root *v* via a new edge, say *f* , as follows. Subdivide an edge of the component that contains *ρ* with a new vertex *u′*, join *u′* and $v$ with *f* , and contract *u*. Then ${\mathcal{T}}^{\prime}$ has been obtained from $\mathcal{T}$ by a *rooted subtree prune and regraft (rSPR) operation*. The rSPR *distance* between two rooted binary phylogenetic *X*-trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ is the minimum number of rSPR operations that transform $\mathcal{T}$ into ${\mathcal{T}}^{\prime}$. We denote this distance by ${d}_{\text{rSPR}}(\mathcal{T},{\mathcal{T}}^{\prime})$.

### Agreement Forests

*X*-trees. Again, to make the following work, regard the roots of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ as a vertex

*ρ*adjoined to the original root by a pendant edge. An

*agreement forest*$\mathcal{F}=\{{\mathcal{L}}_{p},{\mathcal{L}}_{1},{\mathcal{L}}_{2},\mathrm{...},{\mathcal{L}}_{k}\}$ for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ is a partition of $X\cup \left\{\rho \right\}$ such that $\rho \in {\mathcal{L}}_{\rho}$ and the following properties are satisfied:

- (i)
for all

*i*∈ {*ρ*, 1, ...,*k*}, we have $\mathcal{T}|{\mathcal{L}}_{i}\cong {\mathcal{T}}^{\prime}\text{|}{\mathcal{L}}_{i}$, and - (ii)
the trees in $\{\mathcal{T}({\mathcal{L}}_{i}):i\in \{\rho ,1,\mathrm{...},k\left\}\right\}$ and $\{{\mathcal{T}}^{\prime}({\mathcal{L}}_{i}):i\in \{\rho ,1,\mathrm{...},k\left\}\right\}$ are vertex-disjoint subtrees of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$, respectively.

Throughout the remainder of this note, we will interchangeably refer to $\{\mathcal{T}|{\mathcal{L}}_{\rho},\mathcal{T}|{\mathcal{L}}_{1},\mathcal{T}|{\mathcal{L}}_{2},\mathrm{...},\mathcal{T}|{\mathcal{L}}_{k}\}$ and $\{{\mathcal{L}}_{\rho},{\mathcal{L}}_{1},\mathrm{...},{\mathcal{L}}_{k}\}$ as an agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. A *maximum-agreement forest* for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ is an agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ with the smallest number of elements over all agreement forests for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. Note that a maximum-agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ is not necessarily unique.

Bordewich and Semple [5] established the following characterization which directly relates the rSPR distance to the number of elements in a maximum-agreement forest and is crucial to many algorithms that exactly compute the rSPR distance between two rooted binary phylogenetic trees.

**Theorem 1**.

*Let*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*be two rooted binary phylogenetic X-trees, and let*$\{{\mathcal{T}}_{\rho},{\mathcal{T}}_{1},{\mathcal{T}}_{2},\mathrm{...},{\mathcal{T}}_{k}\}$

*be a maximum-agreement forest for*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*. Then*

### Clusters

Let $\mathcal{T}$ be a rooted binary phylogenetic *X*-tree, and let *A* be a subset of *X* with |*A*| ≥ 2. We say that *A* is a *cluster* of $\mathcal{T}$ if there is a vertex $v$ in $\mathcal{T}$ whose set of descendants is precisely *A*. We denote this cluster by ${\mathcal{C}}_{\mathcal{T}}(v)$.

*X*-trees, and let

*A*be a cluster that is common to $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$; that is there exists a vertex $v$ in $\mathcal{T}$ and a vertex ${v}^{\prime}$ in ${\mathcal{T}}^{\prime}$ such that ${\mathcal{C}}_{\mathcal{T}}(v)={\mathcal{C}}_{{\mathcal{T}}^{\prime}}({v}^{\prime})$. Furthermore, let

*u*(resp.

*u′*) be the parent vertex of $v$ (resp. ${v}^{\prime}$) in $\mathcal{T}$ (resp. ${\mathcal{T}}^{\prime}$), and let

*w*(resp.

*w′*) be the child vertex of

*u*(resp.

*u′*) with $w\ne v$ (resp. ${w}^{\prime}\ne {v}^{\prime}$). If no proper subset of

*A*is a common cluster of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$, we refer to

*A*as a

*minimal cluster*. Moreover,

*A*is a

*solvable cluster*if

*A*is minimal and ${\mathcal{C}}_{\mathcal{T}}(u)={\mathcal{C}}_{{\mathcal{T}}^{\prime}}({u}^{\prime})$. Lastly, we say that

*A*is a

*subtree-like cluster*if

*A*is a solvable cluster and $\mathcal{T}\text{|}{\mathcal{C}}_{\mathcal{T}}(w)\cong {\mathcal{T}}^{\prime}\text{|}{\mathcal{C}}_{{\mathcal{T}}^{\prime}}({w}^{\prime})$. Roughly speaking, the condition $\mathcal{T}\text{|}{\mathcal{C}}_{\mathcal{T}}(w)\cong {\mathcal{T}}^{\prime}\text{|}{\mathcal{C}}_{{\mathcal{T}}^{\prime}}({w}^{\prime})$ is satisfied if the subtree with root

*w*in $\mathcal{T}$ is identical to the subtree with root

*w′*in ${\mathcal{T}}^{\prime}$. We refer to $\mathcal{T}\text{|}{\mathcal{C}}_{\mathcal{T}}(w)$ as the

*common subtree associated with A*and note that it can exclusively consist of an isolated vertex. For example,

*A*= {1, 2, ..., 6} is a solvable cluster of the two rooted binary phylogenetic

*X*-trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ that are shown in Figure 1 since ${\mathcal{C}}_{\mathcal{T}}(u)={\mathcal{C}}_{{\mathcal{T}}^{\prime}}({u}^{\prime})$ = {1, 2, ..., 12}. However, as $\mathcal{T}|(7,8,\phantom{\rule{0.5em}{0ex}}\dots ,\phantom{\rule{0.5em}{0ex}}12)\overline{)\cong}{\mathcal{T}}^{\prime}|(7,8,\phantom{\rule{0.5em}{0ex}}\dots ,\phantom{\rule{0.5em}{0ex}}12)$, it follows that

*A*is not a subtree-like cluster of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$.

*minimal, solvable, subtree-like*}. We next describe algorithmically how to obtain a sequence of tree pairs--which is important to mathematically state Hill et al's conjecture--by decomposing two rooted binary phylogenetic

*X*-trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ into smaller subtrees. As previously, view the roots of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ as a vertex

*ρ*adjoined to the original root by a pendant edge, and regard

*ρ*as part of the label set; that is $\mathcal{L}(\mathcal{T})=X\cup \left\{\rho \right\}$. Setting

*i*to be 1, let

*A*

_{ i }be a common Θ cluster of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ with $|\mathcal{L}(\mathcal{T})|-|{A}_{i}|>1$. Let ${\mathcal{T}}_{i}$ denote the rooted binary phylogenetic tree $\mathcal{T}|{A}_{i}$ (viewing the root of ${\mathcal{T}}_{i}$ as a vertex

*ρ*

_{ i }adjoined to the original root by a pendant edge) and reset $\mathcal{T}$ to be the tree obtained from $\mathcal{T}$ by replacing $\mathcal{T}({A}_{i})$ with a new vertex

*a*

_{ i }. Analogously, let ${{\mathcal{T}}^{\prime}}_{i}$ denote the rooted binary phylogenetic tree ${\mathcal{T}}^{\prime}|{A}_{i}$ (viewing the root of ${{\mathcal{T}}^{\prime}}_{i}$ as a vertex

*ρ*

_{ i }adjoined to the original root by a pendant edge) and reset ${\mathcal{T}}^{\prime}$ to be the tree obtained from ${\mathcal{T}}^{\prime}$ by replacing ${\mathcal{T}}^{\prime}({A}_{i})$ with a new vertex

*a*

_{ i }. If $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ contain a Θ cluster

*A*

_{i+1 }with $|\mathcal{L}(\mathcal{T})|-|{A}_{i+1}|>1$, stop or increment

*i*by 1 and repeat this process; otherwise, stop. Eventually, we obtain a sequence

*a*

_{ t }. We call this sequence a

*cluster sequence*of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ with respect to a specific cluster type Θ. An example of a cluster sequence with respect to Θ =

*solvable*for the two rooted binary phylogenetic trees depicted in Figure 1 is shown in Figure 2.

## Hill et al's Conjecture and a Counterexample

We begin this section by formally stating Hill et al's conjecture which was introduced in [1].

**Conjecture 2**.

*Let*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*be two rooted binary phylogenetic X-trees. Let*$({\mathcal{T}}_{\text{1}},{{\mathcal{T}}^{\prime}}_{1}),\mathrm{...},({\mathcal{T}}_{t},{{\mathcal{T}}^{\prime}}_{t}),({\mathcal{T}}_{\rho},{{\mathcal{T}}^{\prime}}_{\rho})$

*be a cluster sequence for*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*with respect to*Θ =

*solvable. Then*

*X*-trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ that are shown in Figure 1. A maximum-agreement forest $\mathcal{F}$ for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ contains 5 elements and is shown in the top of Figure 3. By Theorem 1, this implies that ${d}_{\text{rSPR}}(\mathcal{T},{\mathcal{T}}^{\prime})=4$. Now, consider the cluster sequence with respect to Θ =

*solvable*for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ that contains three tree pairs and is depicted in Figure 2. The first tree pair (${\mathcal{T}}_{1},{{\mathcal{T}}^{\prime}}_{1}$) consists of the restricted subtrees of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ whose leaf set is the solvable cluster

*A*

_{1}= {1, 2, ..., 6} of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$; thus ${\mathcal{T}}_{1}=\mathcal{T}|({A}_{1}\cup \left\{{\rho}_{1}\right\})$ and ${{\mathcal{T}}^{\prime}}_{1}={\mathcal{T}}^{\prime}|({A}_{1}\cup \left\{{\rho}_{1}\right\})$. Similarly, the second tree pair (${\mathcal{T}}_{2},{{\mathcal{T}}^{\prime}}_{2}$) consists of the restricted subtrees of the two trees that have been obtained from $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ by replacing $\mathcal{T}({A}_{1})$ and ${\mathcal{T}}^{\prime}({A}_{1})$, respectively, with a single leaf

*a*

_{1}whose leaf set is the solvable cluster

*A*

_{2}= {7, 8, ..., 12}. Lastly, the third tree pair (${\mathcal{T}}_{\rho},{{\mathcal{T}}^{\prime}}_{\rho}$) can be regarded as being obtained from $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ by replacing $\mathcal{T}({A}_{1})$ and ${\mathcal{T}}^{\prime}({A}_{1})$ with a leaf

*a*

_{1}and replacing $\mathcal{T}({A}_{2})$ and ${\mathcal{T}}^{\prime}({A}_{2})$ with a leaf

*a*

_{2}. For each tree pair (${\mathcal{T}}_{i},{{\mathcal{T}}^{\prime}}_{i}$) of the cluster sequence shown in Figure 2, a maximum-agreement forest ${\mathcal{F}}_{i}$ with

*i*∈ {1, 2,

*ρ*} is depicted in the bottom part of Figure 3. Note that each forest ${\mathcal{F}}_{i}$ is the unique maximum-agreement forest for ${\mathcal{T}}_{i}$ and ${{\mathcal{T}}^{\prime}}_{i}$ Now, by Equation 1, we have

which is strictly greater than ${d}_{\text{rSPR}}(\mathcal{T},{\mathcal{T}}^{\prime})$; thus showing that Conjecture 2 does not hold.

## Using Subtree-Like Clusters to Prove Hill et al's Conjecture

In this section, we show that Conjecture 2 holds, if we consider a subtree-like cluster instead of a solvable cluster in each iteration of computing a cluster sequence for two rooted binary phylogenetic trees. We first prove the result for a cluster sequence of size two and then see that this result generalizes to cluster sequences of greater size.

**Lemma 3**.

*Let*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*be two rooted binary phylogenetic X-trees. Let*(${\mathcal{T}}_{1},{{\mathcal{T}}^{\prime}}_{1}$), (${\mathcal{T}}_{\rho},{{\mathcal{T}}^{\prime}}_{\rho}$)

*be a cluster sequence for*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*with respect to*Θ =

*subtree-like. Then*

*Proof*. Let *A*_{1} be the subtree-like cluster $\mathcal{L}({\mathcal{T}}_{1})-\left\{{\rho}_{1}\right\}$ of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. We start by making an observation that is crucial for what follows. By the definition of a subtree-like cluster, there exists a common subtree, say $\mathcal{S}$, that is associated with *A*_{1} in $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. Clearly, $\mathcal{S}$ is also a common subtree of ${\mathcal{T}}_{\rho}$ and ${{\mathcal{T}}^{\prime}}_{\rho}$. Furthermore, as ${\mathcal{T}}_{\rho}$ has been obtained from $\mathcal{T}$ by replacing $\mathcal{T}({A}_{1})$ with a single vertex *a*_{1} and as ${{\mathcal{T}}^{\prime}}_{\rho}$ has been obtained from ${\mathcal{T}}^{\prime}$ by replacing ${\mathcal{T}}^{\prime}({A}_{1})$ with a single vertex *a*_{1}, it is easily checked that $\mathcal{T}$|($\mathcal{L}(\mathcal{S})\cup \left\{{a}_{1}\right\}$) is a common subtree of ${\mathcal{T}}_{\rho}$ and ${{\mathcal{T}}^{\prime}}_{\rho}$.

*ρ*

_{1}∈ ${\mathcal{L}}_{{\rho}_{1}}$. As ${\mathcal{F}}_{1}$ is an agreement forest for ${\mathcal{T}}_{1}$ and ${{\mathcal{T}}^{\prime}}_{1}$ and as ${\mathcal{F}}_{\rho}$ is such a forest for ${\mathcal{T}}_{\rho}$ and ${{\mathcal{T}}^{\prime}}_{\rho}$, it follows that

*a*

_{1}} always contains an element, note that $({\mathcal{L}}_{{\rho}_{1}}-\{{\rho}_{1}\})\cup ({\mathcal{L}}_{{a}_{1}}-\{{a}_{1}\})$ is never the empty set. Thus $|\mathcal{F}|=|{\mathcal{F}}_{1}|+|{\mathcal{F}}_{\rho}|-1$ and, by Theorem 1, we have

This establishes Equation 2.

*A*

_{1}or a subset of $(X-{A}_{1})\cup \left\{\rho \right\}$. Furthermore, as

*A*

_{1}is a subtree-like cluster of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ whose associated common subtree is $\mathcal{S}$, it again follows from Proposition 3.2 of [5], that $\mathcal{L}(\mathcal{S})$ is a subset of an element, say ${\mathcal{L}}_{\mathcal{S}}$, in $\mathcal{F}$. Now, as $\mathcal{F}$ is an agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$, it follows that

This establishes Equation 3, and combining Equations 2 and 3 completes the proof of this lemma.

The next theorem directly follows from repeated applications of Lemma 3.

**Theorem 4**.

*Let*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*be two rooted binary phylogenetic X-trees. Let*$({\mathcal{T}}_{\text{1}},{{\mathcal{T}}^{\prime}}_{1}),\mathrm{...},({\mathcal{T}}_{t},{{\mathcal{T}}^{\prime}}_{t}),({\mathcal{T}}_{\rho},{{\mathcal{T}}^{\prime}}_{\rho})$

*be a cluster sequence for*$\mathcal{T}$

*and*${\mathcal{T}}^{\prime}$

*with respect to*Θ =

*subtree-like. Then*

## Conclusion

*solvable*for two rooted binary phylogenetic trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. Calculating a maximum-agreement forest for each tree pair (${\mathcal{T}}_{i},{{\mathcal{T}}^{\prime}}_{i}$), taking their union, and, for each

*i*∈; {1, 2, ...,

*t*}, joining the element containing

*a*

_{ i }with the element containing

*ρ*

_{ i }can potentially result in a set, say $\mathcal{G}$, which contains an element that is a subset of {

*a*

_{1},

*a*

_{2}, ...,

*a*

_{ t },

*ρ*

_{1},

*ρ*

_{2}, ...,

*ρ*

_{ t }}. In the case of our counterexample,

contains one such element. Trivially, this element is not part of any agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ while $\mathcal{G}$ - {{*a*_{1}, *a*_{2}, *ρ*_{1}, *ρ*_{2}}} is precisely a maximum-agreement forest for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. Consequently, a divide-and-conquer approach that exactly calculates ${d}_{\text{rSPR}}(\mathcal{T},{\mathcal{T}}^{\prime})$ needs to take into account the number of elements in $\mathcal{G}$ that are subsets of {*a*_{1}, *a*_{2}, ..., *a*_{
t
} , *ρ*_{1}, *ρ*_{2}, ..., *ρ*_{
t
} }; otherwise, the result may be an overestimate of the exact solution. Alternatively, one can approach the problem by finding a strategy which guarantees that no element in $\mathcal{G}$ is a subset of {*a*_{1}, *a*_{2}, ..., *a*_{
t
} , *ρ*_{1}, *ρ*_{2}, ..., *ρ*_{
t
} }. This is the underlying idea of Theorem 4 which uses a slightly more restricted version of Hill et al's conjecture and finally gives the desired outcome. Hence, decomposing $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ into a cluster sequence with respect to Θ = *subtree-like* can be used to speed up the exact calculation of ${d}_{\text{rSPR}}(\mathcal{T},{\mathcal{T}}^{\prime})$.

However, for practical problem instances, it may be unlikely to find many subtree-like clusters. For example, the two phylogenies shown in Figure 1 do not have any common subtree-like cluster. This is due to the restricted definition of such a cluster which requires that a vertex whose set of descendants is a common cluster of two rooted binary phylogenetic *X*-trees $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ has the same parent vertex than a common subtree of $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$. To lessen this problem, an alternative approach--that has recently been published by Linz and Semple [6]--can be applied. This paper describes a more general divide-and-conquer approach that exactly computes the rSPR distance between $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ for when a cluster sequence $({\mathcal{T}}_{\text{1}},{{\mathcal{T}}^{\prime}}_{1}),\mathrm{...},({\mathcal{T}}_{t},{{\mathcal{T}}^{\prime}}_{t}),({\mathcal{T}}_{\rho},{{\mathcal{T}}^{\prime}}_{\rho})$ with respect to Θ = *minimal* for $\mathcal{T}$ and ${\mathcal{T}}^{\prime}$ is given. Loosely speaking, the authors calculate a so-called minimum-weight partition $\mathcal{G}$ of *X* ∪ {*ρ*} ∪ {*a*_{1}, *a*_{2}, ..., *a*_{
t
} , *ρ*_{1}, *ρ*_{2}, ..., *ρ*_{
t
} } such that $\mathcal{G}$ contains an agreement forest (not necessarily a maximum-agreement forest) for each tree pair (${\mathcal{T}}_{i},{{\mathcal{T}}^{\prime}}_{i}$). To compute $\mathcal{G}$, it has been shown that applying a 'bottom-up' approach which locally works on subtrees of each tree pair (${\mathcal{T}}_{i},{{\mathcal{T}}^{\prime}}_{i}$) guarantees that the number of elements in $\mathcal{G}$ that are subsets of {*a*_{1}, *a*_{2}, ..., *a*_{
t
} , *ρ*_{1}, *ρ*_{2}, ..., *ρ*_{
t
} } is maximized while |$\mathcal{G}$| is minimized.

## Declarations

### Acknowledgements

I thank Maria Luisa Bonet, Mareike Fischer, and Charles Semple for useful discussions and comments on an earlier version of this paper. Financial support from MEC (TIN2007-68005-C04-03) is gratefully acknowledged.

**Response**

By Helgi B Schiöth

E-Mail: helgis@bmc.uu.se

Address: Department of Neuroscience, Functional Pharmacology, Uppsala University, BMC, Box 593, 751 24, Uppsala, Sweden

"We have found that the manuscript by Linz is correct and to the point. We have therefore updated the SPRIT software and published the new version online.

The new version supports both the old incorrect conjecture as well as the new correct one to allow for comparisons to be made."

## Authors’ Affiliations

## References

- Hill T, Nordström KJV, Thollesson M, Säfström TM, Vernersson AKE, Fredriksson R, Schiöth HB: SPRIT: Identifying horizontal gene transfer in rooted phylogenetic trees. BMC Evol Biol. 2010, 10: 42-10.1186/1471-2148-10-42.PubMed CentralView ArticlePubMedGoogle Scholar
- Hein J, Jing T, Wang L, Zhang K: On the complexity of comparing evolutionary trees. Discrete Appl Math. 1996, 71: 153-169. 10.1016/S0166-218X(96)00062-5.View ArticleGoogle Scholar
- Baroni M, Grünewald S, Moulton V, Semple C: Bounding the number of hybridization events for a consistent evolutionary history. J Math Biol. 2005, 51: 171-182. 10.1007/s00285-005-0315-9.View ArticlePubMedGoogle Scholar
- Semple C, Steel M: Phylogenetics. 2003, Oxford University PressGoogle Scholar
- Bordewich M, Semple C: On the computational complexity of the rooted subtree prune and regraft distance. Ann Comb. 2004, 8: 409-423. 10.1007/s00026-004-0229-z.View ArticleGoogle Scholar
- Linz S, Semple C: A cluster reduction for computing the subtree distance between phylogenies. Ann CombGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.