Sequential decoding
Recognised by John Wozencraft, sequential decoding is a limited memory technique for decoding tree codes. Sequential decoding is mainly used as an approximate decoding algorithm for long constraint-length convolutional codes. This approach may not be as accurate as the Viterbi algorithm but can save a substantial amount of computer memory. It was used to decode a convolutional code in 1968 Pioneer 9 mission. Sequential decoding explores the tree code in such a way to try to minimise the computational cost and memory requirements to store the tree. There is a range of sequential decoding approaches based on  the choice of metric and algorithm. Metrics include: Algorithms include: Fano metric. Given a partially explored tree (represented by a set of nodes which are limit of exploration), we would like to know the best node from which to explore further. The Fano metric (named after Robert Fano) allows one to calculate from which is the best node to explore further. This metric is optimal given no other constraints (e.g. memory). For a binary symmetric channel (with error probability formula_1) the Fano metric can be derived via Bayes theorem. We are interested in following the most likely path formula_2 given  an explored state of the tree formula_3 and a received sequence formula_4. Using the language of probability and Bayes theorem we want to choose the maximum over formula_5 of: We now introduce the following notation: We express the likelihood formula_14 as formula_15 (by using the binary symmetric channel likelihood for the first formula_16 bits followed by a uniform prior over the remaining bits). We express the prior formula_17 in terms of the number of branch choices one has made, formula_12, and the number of branches from each node, formula_19. Therefore: We can equivalently maximise the log of this probability, i.e.  This last expression is the Fano metric. The important point to see is that we have two terms here: one based on the number of wrong bits and one based on the number of right bits. We can therefore update the Fano metric simply by adding formula_22 for each non-matching bit and formula_23 for each matching bit. Computational cutoff rate. For sequential decoding to a good choice of decoding algorithm, the number of states explored wants to remain small (otherwise an algorithm which deliberately explores all states, e.g. the Viterbi algorithm, may be more suitable). For a particular noise  level there is a maximum coding rate formula_24 called the computational cutoff rate where there is a finite backtracking limit. For the binary symmetric channel: Algorithms. Stack algorithm. The simplest algorithm to describe is the "stack algorithm" in which the best formula_7 paths found so far are stored. Sequential decoding may introduce an additional error above Viterbi decoding when the correct path has formula_7 or more highly scoring paths above it; at this point the best path will drop off the stack and be no longer considered. Fano algorithm. The famous Fano algorithm (named after Robert Fano) has a very  low memory requirement and hence is suited to hardware implementations. This algorithm explores backwards and forward from a single point on the tree.