design of capacity approaching irregular low density parity check codes we design low density parity check ldpc codes that perform at rates extremely close to the shannon capacity the codes are built from highly irregular bipartite graphs with carefully chosen degree patterns on both sides our theoretical analysis of the codes is based on the work of richardson and urbanke see ibid vol 47 no 2 p 599 618 2000 assuming that the underlying communication channel is symmetric we prove that the probability densities at the message nodes of the graph possess a certain symmetry using this symmetry property we then show that under the assumption of no cycles the message densities always converge as the number of iterations tends to infinity furthermore we prove a stability condition which implies an upper bound on the fraction of errors that a belief propagation decoder can correct when applied to a code induced from a bipartite graph with a given degree distribution our codes are found by optimizing the degree structure of the underlying graphs we develop several strategies to perform this optimization we also present some simulation results for the codes found which show that the performance of the codes is very close to the asymptotic theoretical bounds

an efficient algorithm to find all small size stopping sets of low density parity check matrices in this work we introduce an efficient algorithm to find all stopping sets of size less than some threshold of a fixed low density parity check ldpc matrix the solution is inspired by the algorithm proposed by rosnes and ytrehus in 2005 to find an exhaustive list of all small size turbo stopping sets in a turbo code the efficiency of the proposed algorithm is demonstrated by several numerical examples for instance we have applied the algorithm to the well known 3 5 regular 155 64 tanner code and found all stopping sets of size at most 18 in about 1 min on a standard desktop computer also we have verified that the minimum stopping set size of the 4896 2474 ramanujan margulis code is indeed 24 and that the corresponding multiplicity is exactly 204 furthermore we have applied the algorithm to the ieee 802 16e ldpc codes and determined the minimum stopping set size and the corresponding multiplicity exactly for these codes finally as an application we present a greedy algorithm to find a small number of redundant parity checks to add to the original parity check matrix in order to remove all stopping sets in the corresponding tanner graph of size less than the minimum distance an extensive case study of the 155 64 tanner code illustrates the usefulness of the algorithm and we present a 110 times 155 redundant parity check matrix for this code with no stopping sets of size less than the minimum distance simulation results of iterative decoding on the binary erasure channel show performance improvements for low to medium erasure probabilities when this redundant parity check matrix is used for decoding

algebraic construction of sparse matrices with large girth in this correspondence we present a method for constructing sparse matrices that have a compact description and whose associated bipartite graphs have large girth based on an arbitrary seed matrix of nonnegative integers a new matrix is constructed which replaces each entry of the seed matrix with a sum of permutation matrices algebraic conditions that lead to short cycles in the associated bipartite graph are analyzed and methods to achieve large girth in two special cases are presented in one all the permutation matrices are circulants in the other they are all affine permutation matrices when used to define a low density parity check ldpc code the compact description should lead to efficient implementation and the large girth to good error correction performance the method is adaptable to a variety of rates and a variety of row and column degrees

the trapping redundancy of linear block codes we generalize the notion of the stopping redundancy in order to study the smallest size of a trapping set in tanner graphs of linear block codes in this context we introduce the notion of the trapping redundancy of a code which quantifies the relationship between the number of redundant rows in any parity check matrix of a given code and the size of its smallest trapping set trapping sets with certain parameter sizes are known to cause error floors in the performance curves of iterative belief propagation bp decoders and it is therefore important to identify decoding matrices that avoid such sets bounds on the trapping redundancy are obtained using probabilistic and constructive methods and the analysis covers both general and elementary trapping sets numerical values for these bounds are computed for the 2640 1320 margulis code and the class of projective geometry codes and compared with some new code specific trapping set size estimates

a class of quasi cyclic ldpc codes over gf 2 m low density parity check ldpc codes over gf 2m are an extension of binary ldpc codes performances of gf 2m ldpc codes have been shown to be higher than binary ldpc codes but the complexity of the encoders decoders increases hence there is a substantial lack of implementations for ldpc codes over gf 2m codes this paper presents a class of quasi cyclic ldpc codes over gf 2m these codes can alleviate the encoding decoding complexity without excessive loss of performances it is shown how from a performance point of view such codes are better than m times bigger binary codes and as good as 2m longer binary codes

new constructions of quasi cyclic ldpc codes based on special classes of bibd s for the awgn and binary erasure channels this paper presents new methods for efficiently constructing encodable quasi cyclic low density parity check ldpc codes based on special balanced incomplete block designs bibds codes constructed perform well over both the additive white gaussian noise awgn and binary erasure channels with iterative decoding

low density parity check codes based on finite geometries a rediscovery and new results this paper presents a geometric approach to the construction of low density parity check ldpc codes four classes of ldpc codes are constructed based on the lines and points of euclidean and projective geometries over finite fields codes of these four classes have good minimum distances and their tanner 1981 graphs have girth 6 finite geometry ldpc codes can be decoded in various ways ranging from low to high decoding complexity and from reasonably good to very good performance they perform very well with iterative decoding furthermore they can be put in either cyclic or quasi cyclic form consequently their encoding can be achieved in linear time and implemented with simple feedback shift registers this advantage is not shared by other ldpc codes in general and is important in practice finite geometry ldpc codes can be extended and shortened in various ways to obtain other good ldpc codes several techniques of extension and shortening are presented long extended finite geometry ldpc codes have been constructed and they achieve a performance only a few tenths of a decibel away from the shannon theoretical limit with iterative decoding

reversible low density parity check codes low density parity check ldpc codes may be decoded using a circuit implementation of the sum product algorithm which maps the factor graph of the code by reusing the decoder for encoding both tasks can be performed using the same circuit thus reducing area and verification requirements motivated by this iterative encoding techniques based upon the graphical representation of the code are proposed code design constraints which ensure encoder convergence are presented and then used to design iteratively encodable codes while also preventing 4 cycle creation we show how the jacobi method for iterative matrix inversion can be applied to finite field matrices viewed as message passing and employed as the core of an iterative encoder we present an algebraic construction of 4 cycle free iteratively encodable codes using circulant matrices analysis of these codes identifies a weakness in their structure due to a repetitive pattern in the factor graph the graph supports pseudo codewords of low pseudo weight in order to remove the repetitive pattern in the graph we propose a recursive technique for generating iteratively encodable codes the new codes offer flexibility in the choice of code length and rate and performance that compares well to randomly generated quasi cyclic and extended euclidean geometry codes

high rate quantum low density parity check codes assisted by reliable qubits quantum error correction is an important building block for reliable quantum information processing a challenging hurdle in the theory of quantum error correction is that it is significantly more difficult to design error correcting codes with desirable properties for quantum information processing than for traditional digital communications and computation a typical obstacle to constructing a variety of strong quantum error correcting codes is the complicated restrictions imposed on the structure of a code recently promising solutions to this problem have been proposed in quantum information science where in principle any binary linear code can be turned into a quantum error correcting code by assuming a small number of reliable quantum bits this paper studies how best to take advantage of these latest ideas to construct desirable quantum error correcting codes of very high information rate our methods exploit structured high rate low density parity check codes available in the classical domain and provide quantum analogues that inherit their characteristic low decoding complexity and high error correction performance even at moderate code lengths our approach to designing high rate quantum error correcting codes also allows for making direct use of other major syndrome decoding methods for linear codes making it possible to deal with a situation where promising quantum analogues of low density parity check codes are difficult to find

a new construction of structured binary regular ldpc codes based on steiner systems with parameter t 2 this paper presents a novel method for constructing structured regular low density parity check ldpc codes based on a special type of combinatorial designs known as steiner systems this code design approach can be considered as a generalization of the well known method which uses the point block incidence matrix of a steiner 2 design for the code construction though the given method can be applied on any steiner system s t k v in this paper we focus only on steiner systems with t 3 furthermore we show that not only a steiner system x b itself but also its residual design with respect to an arbitrary point x x can be employed for code construction we also present a technique for constructing binary and non binary qc ldpc codes from steiner systems the tanner graph of the constructed codes is free of 4 cycles and hence the codes have girth at least six simulation results show that the so constructed codes perform well over the awgn channel with iterative message passing decoding

construction of low density parity check codes based on balanced incomplete block designs this correspondence presents a method for constructing structured regular low density parity check ldpc codes based on a special type of combinatoric designs known as balance incomplete block designs codes constructed by this method have girths at least 6 and they perform well with iterative decoding furthermore several classes of these codes are quasi cyclic and hence their encoding can be implemented with simple feedback shift registers

construction of nonbinary cyclic quasi cyclic and regular ldpc codes a finite geometry approach this paper presents five methods for constructing nonbinary ldpc codes based on finite geometries these methods result in five classes of nonbinary ldpc codes one class of cyclic ldpc codes three classes of quasi cyclic ldpc codes and one class of structured regular ldpc codes experimental results show that constructed codes in these classes decoded with iterative decoding based on belief propagation perform very well over the awgn channel and they achieve significant coding gains over reed solomon codes of the same lengths and rates with either algebraic hard decision decoding or kotter vardy algebraic soft decision decoding at the expense of a larger decoding computational complexity

a recursive approach to low complexity codes a method is described for constructing long error correcting codes from one or more shorter error correcting codes referred to as subcodes and a bipartite graph a graph is shown which specifies carefully chosen subsets of the digits of the new codes that must be codewords in one of the shorter subcodes lower bounds to the rate and the minimum distance of the new code are derived in terms of the parameters of the graph and the subeodes both the encoders and decoders proposed are shown to take advantage of the code s explicit decomposition into subcodes to decompose and simplify the associated computational processes bounds on the performance of two specific decoding algorithms are established and the asymptotic growth of the complexity of decoding for two types of codes and decoders is analyzed the proposed decoders are able to make effective use of probabilistic information supplied by the channel receiver e g reliability information without greatly increasing the number of computations required it is shown that choosing a transmission order for the digits that is appropriate for the graph and the subcodes can give the code excellent burst error correction abilities the construction principles

iterative decoding of one step majority logic deductible codes based on belief propagation previously the belief propagation bp algorithm has received a lot of attention in the coding community mostly due to its near optimum decoding for low density parity check ldpc codes and its connection to turbo decoding in this paper we investigate the performance achieved by the bp algorithm for decoding one step majority logic decodable osmld codes the bp algorithm is expressed in terms of likelihood ratios rather than probabilities as conventionally presented the proposed algorithm fits better the decoding of osmld codes with respect to its numerical stability due to the fact that the weights of their check sums are often much higher than that of the corresponding ldpc codes although it has been believed that osmld codes are far inferior to ldpc codes we show that for medium code lengths say between 200 1000 bits the bp decoding of osmld codes can significantly outperform bp decoding of their equivalent ldpc codes the reasons for this behavior are elaborated

high performance entanglement assisted quantum ldpc codes need little entanglement though the entanglement assisted formalism provides a universal connection between a classical linear code and an entanglement assisted quantum error correcting code eaqecc the issue of maintaining large amount of pure maximally entangled states in constructing eaqeccs is a practical obstacle to its use it is also conjectured that the power of entanglement assisted formalism to convert those good classical codes comes from massive consumption of maximally entangled states we show that the above conjecture is wrong by providing families of eaqeccs with an entanglement consumption rate that diminishes linearly as a function of the code length notably two families of eaqeccs constructed in the paper require only one copy of maximally entangled state no matter how large the code length is these families of eaqeccs that are constructed from classical finite geometric ldpc codes perform very well according to our numerical simulations our work indicates that eaqeccs are not only theoretically interesting but also physically implementable finally these high performance entanglement assisted ldpc codes with low entanglement consumption rates allow one to construct high performance standard qeccs with very similar parameters

expander codes using expander graphs we construct a new family of asymptotically good linear error correcting codes these codes have linear time sequential decoding algorithms and logarithmic time parallel decoding algorithms that use a linear number of processors we present both randomized and explicit constructions of these codes experimental results demonstrate the good performance of the randomly chosen codes

high rate quasi cyclic low density parity check codes derived from finite affine planes this paper shows that several attractive classes of quasi cyclic qc low density parity check ldpc codes can be obtained from affine planes over finite fields one class of these consists of duals of one generator qc codes presented here for codes contained in this class are the exact minimum distance and a lower bound on the multiplicity of the minimum weight codewords further it is shown that the minimum hamming distance of a code in this class is equal to its minimum additive white gaussian noise awgn pseudoweight also discussed is a class consisting of codes from circulant permutation matrices and an explicit formula for the rank of the parity check matrix is presented for these codes additionally it is shown that each of these codes can be identified with a code constructed from a constacyclic maximum distance separable code of dimension 2 the construction is similar to the derivation of reed solomon rs based ldpc codes presented by chen and djurdjevic experimental results show that a number of high rate qc ldpc codes with excellent error performance are contained in these classes

on minimum wer performance of a class of ldpc codes for the bsc e under extended bounded distance decoding we study the word error rate wer performance and the wer minimizing decision thresholds plusmnt for the class of row column diagonal rcd array codes and their generalizations on the binary symmetric channel with erasures bsc e where decoding is via an extended bounded distance decoder e bdd this model applies to very high data rate systems where soft decision iterative decoding is impractical we demonstrate that substantial wer performance gain can be obtained especially at higher channel signal to noise ratio csnr csnr delta 10 log10 1 2sigma2 values by employing two optimal thresholds plusmnt chosen to minimize wer we study the wer improvement and signal to noise ratio snr performance gain as a function of code length n for fixed minimum distance dmin and as a function of dmin for fixed n a distinct difference in the behavior of wer versus the threshold t and the optimal threshold t versus snr is observed between codes with odd and even dmin with the even dmin codes exhibiting larger performance improvements when employing a bsc e instead of a bsc

mean field and mixed mean field iterative decoding of low density parity check codes in this paper the mean field mf and mixed mean field mmf algorithms for decoding low density parity check ldpc codes are considered the mf principle is well established in statistical physics and artificial intelligence instead of using a single completely factorized approximated distribution as in the mf approach the mixed mf algorithm forms a weighted average of several mf distributions as an approximation of the true posterior probability distribution the mf decoding algorithm for linear block codes is derived and shown to be an approximation of the a posteriori probability app decoding algorithm the mf approach is then developed in the context of iterative decoding and presented as an approximation of the popular belief propagation decoding method these results are extended to iterative decoding with the mmf algorithm simulation results show that the mf and mmf decoding algorithms yield a good performance complexity tradeoff especially when employed for decoding ldpc codes based on finite geometries

cyclic and quasi cyclic ldpc codes on constrained parity check matrices and their trapping sets this paper is concerned with construction and structural analysis of both cyclic and quasi cyclic codes particularly low density parity check ldpc codes it consists of three parts the first part shows that a cyclic code given by a parity check matrix in circulant form can be decomposed into descendant cyclic and quasi cyclic codes of various lengths and rates some fundamental structural properties of these descendant codes are developed including the characterization of the roots of the generator polynomial of a cyclic descendant code the second part of the paper shows that cyclic and quasi cyclic descendant ldpc codes can be derived from cyclic finite geometry ldpc codes using the results developed in the first part of the paper this enlarges the repertoire of cyclic ldpc codes the third part of the paper analyzes the trapping set structure of regular ldpc codes whose parity check matrices satisfy a certain constraint on their rows and columns several classes of finite geometry and finite field cyclic and quasi cyclic ldpc codes with large minimum distances are shown to have no harmful trapping sets of size smaller than their minimum distances consequently their error floor performances are dominated by their minimum distances

diagnosis problem solving using fuzzy relations this paper deals with the restoration and the identification of the causes diagnoses through the observed effects symptoms on the basis of fuzzy relations and zadeh s compositional rule of inference we propose an approach for building fuzzy systems of diagnosis which enables solving fuzzy relational equations together with design and tuning of fuzzy relations on the basis of expert and experimental information the essence of tuning consists of the selection such membership functions for fuzzy causes and effects and also fuzzy relations which minimize the difference between model and experimental results of diagnosis the genetic algorithm is used for solving the optimization problem the proposed approach is illustrated by the computer experiment and the real example of diagnosis

computing linear transformations with unreliable components we consider the problem of computing a binary linear transformation when all circuit components are unreliable two models of unreliable components are considered probabilistic errors and permanent errors we introduce the encoded technique that ensures that the error probability of the computation of the linear transformation is kept bounded below a small constant independent of the size of the linear transformation even when all logic gates in the computation are noisy by deriving a lower bound we show that in some cases the computational complexity of the encoded technique achieves the optimal scaling in error probability further we examine the gain in energy efficiency from the use of a voltage scaling scheme where gate energy is reduced by lowering the supply voltage we use a gate energy reliability model to show that tuning gate energy appropriately at different stages of the computation dynamic voltage scaling in conjunction with encoded can lead to orders of magnitude energy savings over the classical uncoded approach finally we also examine the problem of computing a linear transformation when noiseless decoders can be used providing upper and lower bounds to the problem

hierarchical and high girth qc ldpc codes we present an approach to designing capacity approaching high girth low density parity check ldpc codes that are friendly to hardware implementation and compatible with some desired input code structure defined using a protograph the approach is based on a mapping of any class of codes defined using a protograph into a family of hierarchical quasi cyclic hqc ldpc codes whereas the parity check matrices of standard quasi cyclic qc ldpc codes are composed of circulant submatrices those of hqc ldpc codes are composed of a hierarchy of circulant submatrices that are in turn constructed from circulant submatrices and so on through some number of levels next we present a girth maximizing algorithm that optimizes the degrees of freedom within the family of codes to yield a high girth hqc ldpc code subject to bounds imposed by the fact that hqc codes are still quasi cyclic finally we discuss how certain characteristics of a code protograph will lead to inevitable short cycles and show that these short cycles can be eliminated using a squashing procedure that results in a high girth qc ldpc code although not a hierarchical one we illustrate our approach with three design examples of qc ldpc codes two girth 10 codes of rates 1 3 and 0 45 and one girth 8 code of rate 0 7 all of which are obtained from protographs of one sided spatially coupled codes

new classes of partial geometries and their associated ldpc codes the use of partial geometries to construct parity check matrices for binary low density parity check ldpc codes has resulted in the design of successful codes with a probability of error on the awgn channel close to the shannon capacity at bit error rate down to 10 15 such considerations have motivated this further investigation a new and simple construction of a type of partial geometries with a quasi cyclic qc structure is given and their properties are investigated two new classes of this type of partial geometries one based on prime fields and the other based on cyclic subgroups of prime orders of finite fields are constructed qc ldpc codes with good error performances are constructed based on these two new classes of partial geometries the trapping sets of the partial geometry codes were previously considered using the geometric aspects of the underlying structure to derive information on the size of allowable trapping sets this topic is further considered here finally there is a natural relationship between partial geometries and strongly regular graphs the eigenvalues of the adjacency matrices of such graphs are well known and it is of interest to determine if any of the tanner graphs derived from the partial geometries are good expanders for certain parameter sets since it can be argued that codes with good geometric and expansion properties might perform well on the awgn channel under message passing decoding

algebraic construction of quasi cyclic ldpc codes for the awgn and erasure channels this paper is concerned with construction of quasi cyclic qc low density parity check ldpc codes for three different types of channels the additive white gaussian noise the binary random erasure and the binary burst erasure channels two algebraic methods for systematic construction of qc ldpc codes are presented codes constructed perform well over all three types of channels

a revolving iterative algorithm for decoding algebraic cyclic and quasi cyclic ldpc codes cyclic and quasi cyclic algebraic ldpc codes constructed based on finite fields finite geometries and combinatorial designs can achieve excellent performance in terms of error rate error floor and rate of decoding convergence with iterative decoding however the relatively high density of the parity check matrix of an algebraic cyclic or quasi cyclic ldpc code makes the hardware implementation complexity of the decoder quite large which may be a critical issue in practical applications this paper presents an effective reduced complexity algorithm for decoding algebraic cyclic and quasi cyclic ldpc codes based on the block cyclic structure and cyclic grouping of the rows of their parity check matrices the decoding of a code is carried out based on a single small submatrix of the parity check matrix of the code in a revolving manner the proposed decoding algorithm significantly reduces the hardware implementation complexity and the size of memory required to store information

new combinatorial construction techniques for low density parity check codes and systematic repeat accumulate codes this paper presents several new construction techniques for low density parity check ldpc and systematic repeat accumulate ra codes based on specific classes of combinatorial designs the improved code design focuses on high rate structured codes with constant column weights 3 and higher the proposed codes are efficiently encodable and exhibit good structural properties experimental results on decoding performance with the sum product algorithm show that the novel codes offer substantial practical application potential for instance in high speed applications in magnetic recording and optical communications channels

reduced complexity iterative decoding of low density parity check codes based on belief propagation two simplified versions of the belief propagation algorithm for fast iterative decoding of low density parity check codes on the additive white gaussian noise channel are proposed both versions are implemented with real additions only which greatly simplifies the decoding complexity of belief propagation in which products of probabilities have to be computed also these two algorithms do not require any knowledge about the channel characteristics both algorithms yield a good performance complexity trade off and can be efficiently implemented in software as well as in hardware with possibly quantized received values

optimal erasure selection of m ary pam signaling for errors and erasures decoding algorithms erasure selection for errors and erasures decoding algorithms is investigated and analyzed where declaring erasures provides additional gain for hard decision decoding to derive an analytical criterion for optimal erasure selection we first investigate erasure effects on decoding performance by which a metric function for erasure selection is derived from the derived metric a suboptimal threshold is defined which can be used for errors and erasures decoding of large code distance channel codes moreover application to m ary m 2 pam constellation is also described for verification of the proposed erasure threshold simulation results with popular channel codes are included

on the pseudocodeword redundancy of binary linear codes for a binary linear code the pseudocodeword redundancy with respect to the additive white gaussian noise channel the binary symmetric channel or the max fractional weight is defined to be the smallest number of rows in a parity check matrix such that the corresponding minimum pseudoweight is equal to the minimum hamming distance of the code it is shown that most codes do not have a finite pseudocodeword redundancy also upper bounds on the pseudocodeword redundancy for some families of codes including codes based on designs are provided the pseudocodeword redundancies for all codes of small length at most 9 are computed furthermore comprehensive results are provided on the cases of cyclic codes of length at most 250 for which the eigenvalue bound of vontobel and koetter is sharp

two regularization methods and the order optimal error estimates for a sideways parabolic equation in this paper we consider an inverse heat conduction problem which appears in some applied subjects this problem is ill posed in the sense that the solution if it exists does not depend continuously on the data a tikhonov type s regularization method and a fourier regularization method are applied to formulate regularized solutions which are stably convergent to the exact ones with order optimal error estimates a numerical example shows that the computational effect of these methods are all satisfactory

a lattice based systematic recursive construction of quasi cyclic ldpc codes this paper presents a low complexity recursive and systematic method to construct good well structured low density parity check ldpc codes the method is based on a recursive application of a partial kronecker product operation on a given gamma x q q ges 3 a prime integer lattice l gamma x q the n 1 fold product of l gamma x q by itself denoted ln gamma x q represents a regular quasi cyclic qc ldpc code denoted see pdf of high rate and girth 6 the minimum distance of see pdf is equal to that of the core code see pdf introduced by l gamma x q the support of the minimum weight codewords in see pdf are characterized by the support of the same type of codewords in see pdf from performance perspective the constructed codes compete with the pseudorandom ldpc codes

generalized low density parity check codes based on hadamard constraints in this paper we consider the design and analysis of generalized low density parity check gldpc codes in awgn channels the gldpc codes are specified by a bipartite tanner graph as with standard ldpc codes but with the single parity check constraints replaced by general coding constraints in particular we consider imposing hadamard code constraints at the check nodes for a low rate approach termed ldpc hadamard codes we introduce a low complexity message passing based iterative soft input soft output siso decoding algorithm which employs the a posteriori probability app fast hadamard transform fht for decoding the hadamard check codes at each decoding iteration the achievable capacity with the gldpc codes is then discussed a modified ldpc hadamard code graph is also proposed we then optimize the ldpc hadamard code ensemble using a low complexity optimization method based on approximating the density evolution by a one dimensional dynamic system represented by an extrinsic mutual information transfer exit chart simulation results show that the optimized ldpc hadamard codes offer better performance in the low rate region than low rate turbo hadamard codes but also enjoy a fast convergence rate a rate 0 003 ldpc hadamard code with large block length can achieve a bit error rate ber performance of 10 5 at 1 44 db which is only 0 15 db away from the ultimate shannon limit 1 592 db and 0 24 db better than the best performing low rate turbo hadamard codes

efficient encoding of quasi cyclic low density parity check codes efficient encoding of quasi cyclic low density parity check codes quasi cyclic qc low density parity check ldpc codes form an important subclass of ldpc codes these codes have encoding advantage over other types of ldpc codes this paper addresses the issue of efficient encoding of qc ldpc codes two methods are presented to find the generator matrices of qc ldpc codes in systematic circulant form from their parity check matrices given in circulant form based on the systematic circulation form of the generator matrix of a qc ldpc code various types of encoding circuits using simple shift registers are devised it is shown that the encoding complexity of a qc ldpc code is linearly proportional to the number of parity bits of the code for serial encoding and to the length of the code for high speed parallel encoding

iterative decoding of binary block and convolutional codes iterative decoding of two dimensional systematic convolutional codes has been termed turbo de coding using log likelihood algebra we show that any decoder can be used which accepts soft inputs including a priori values and delivers soft outputs that can be split into three terms the soft channel and a priori inputs and the extrinsic value the extrinsic value is used as an a priori value for the next iteration decoding algorithms in the log likelihood domain are given not only for convolutional codes but also for any linear binary systematic block code the iteration is controlled by a stop criterion derived from cross entropy which results in a minimal number of iterations optimal and suboptimal decoders with reduced complexity are presented simulation results show that very simple component codes are sufficient block codes are appropriate for high rates and convolutional codes for lower rates less than 2 3 any combination of block and convolutional component codes is possible several interleaving techniques are described at a bit error rate ber of 10 sup 4 the performance is slightly above or around the bounds given by the cutoff rate for reasonably simple block convolutional component codes interleaver sizes less than 1000 and for three to six iterations

linear time encodable and decodable error correcting codes we present a new class of asymptotically good linear error correcting codes these codes can be both encoded and decoded in linear time they can also be encoded by logarithmic depth circuits of linear size and decoded by logarithmic depth circuits of size o nlogn we present both randomized and explicit constructions of these codes

near optimum universal belief propagation based decoding of low density parity check codes in this paper we propose a belief propagation bp based decoding algorithm which utilizes normalization to improve the accuracy of the soft values delivered by a previously proposed simplified bp based algorithm the normalization factors can be obtained not only by simulation but also importantly theoretically this new bp based algorithm is much simpler to implement than bp decoding as it requires only additions of the normalized received values and is universal i e the decoding is independent of the channel characteristics some simulation results are given which show this new decoding approach can achieve an error performance very close to that of bp on the additive white gaussian noise channel especially for low density parity check ldpc codes whose check sums have large weights the principle of normalization can also be used to improve the performance of the max log map algorithm in turbo decoding and some coding gain can be achieved if the code length is long enough

quasicyclic low density parity check codes from circulant permutation matrices in this correspondence the construction of low density parity check ldpc codes from circulant permutation matrices is investigated it is shown that such codes cannot have a tanner graph representation with girth larger than 12 and a relatively mild necessary and sufficient condition for the code to have a girth of 6 8 10 or 12 is derived these results suggest that families of ldpc codes with such girth values are relatively easy to obtain and consequently additional parameters such as the minimum distance or the number of redundant check sums should be considered to this end a necessary condition for the codes investigated to reach their maximum possible minimum hamming distance is proposed

crc handbook of combinatorial designs balanced incomplete block designs and t designs2 v k l designs of small orderbibds with small block sizet designs t 3steiner systemssymmetric designsresolvable and near resolvable designslatin squares mols and orthogonal arrayslatin squaresmutually orthogonal latin squares mols incomplete molsorthogonal arrays of index more than oneorthogonal arrays of strength more than twopairwise balanced designspbds and gdds the basicspbds recursive constructionspbd closurepairwise balanced designs as linear spacespbds and gdds of higher indexpbds frames and resolvabilityother combinatorial designsassociation schemesbalanced part ternary designsbalanced tournament designsbhaskar rao designscomplete mappings and sequencings of finite groupsconfigurationscostas arrayscoveringscycle systemsdifference familiesdifference matricesdifference sets abeliandifference sets nonabeliandifference triangle setsdirected designsd optimal matricesembedding partial quasigroupsequidistant permutation arraysfactorial designsfrequency squaresgeneralized quadranglesgraph decompositions and designsgraphical designshadamard matrices and designshall triple systemshowell designsmaximal sets of molsmendelsohn designsthe oberwolfach problemordered designs and perpendicular arraysorthogonal designsorthogonal main effect planspackingspartial geometriespartially balanced incomplete block designsquasigroupsquasi symmetric designs r l designsroom squaresself orthogonal latin squares sols sols with a symmetric orthogonal mate solssom sequences with zero autocorrelationskolem sequencesspherical t designsstarterstrades and defining sets t m s netstuscan squarest wise balanced designsuniformly resolvable designsvector space designsweighing matrices and conference matriceswhist tournamentsyouden designs generalizedyouden squaresapplicationscodescomputer science selected applicationsapplications of designs to cryptographyderandomizationoptimality and efficiency comparing block designsgroup testingscheduling a tournamentwinning the lotteryrelated mathematics and computational methodsfinite groups and designsnumber theory and finite fieldsgraphs and multigraphsfactorizations of graphsstrongly regular graphstwo graphsclassical geometriesprojective planes nondesarguesiancomputational methods in design theoryindex

bounds on the expansion properties of tanner graphs this work focuses on the expansion properties of a tanner graph because they are known to be related to the performance of associated iterative message passing algorithms over various channels by analyzing the eigenvalues and corresponding eigenvectors of the normalized incidence matrix representing a tanner graph lower bounds on these expansion properties are derived specifically for the binary erasure channel these results lead to two lower bounds on stopping distance for any given binary linear code and an upper bound on stopping redundancy for the family of difference set codes type i 2 d projective geometry low density parity check ldpc codes

construction of structured regular ldpc codes a design theoretic approach a new combinatorial technique for constructing girth 6 structured binary regular low density parity check ldpc codes based on special types of t designs is given a very large number of well known t designs can be used by this method for code construction based on this method a t v k design d x b can be exploited for code construction if it satisfies the following three conditions 1 b1 b2 t for any two blocks b1 b2 b and b1 b2 2 1 and 3 k t though the technique works for any t design satisfying these conditions we focus only on the utilization of simple triple systems super simple bibds steiner systems and large sets lss of t designs we also construct binary and non binary girth 6 qc ldpc codes from the t designs satisfying these conditions by using matrix dispersion method experimental results show that the constructed non binary qc ldpc codes can provide good practical performance under iterative decoding using the fast fourier transform based q ary sum product algorithm fft qspa and they can achieve acceptable coding gains over random like codes of comparable parameters decoded with sum product algorithm spa

iterative algorithms for decoding a class of two step majority logic decodable cyclic codes codes constructed based on finite geometries form a large class of cyclic codes with large minimum distances which can be decoded with simple majority logic decoding in one or multiple steps in 2001 kou lin and fossorier showed that the one step majority logic decodable finite geometry codes form a class of cyclic ldpc codes whose tanner graphs are free of cycles of length 4 these cyclic finite geometry ldpc codes perform very well over the awgn channel using iterative decoding based on belief propagation idbp and have very low error floors however the standard idbp is not effective for decoding other cyclic finite geometry codes because their tanner graphs contain too many short cycles of length 4 which severely degrade the decoding performance this paper investigates iterative decoding of two step majority logic decodable finite geometry codes three effective algorithms for decoding these codes are proposed these algorithms are devised based on the orthogonal structure of the parity check matrices of the codes to avoid or reduce the degrading effect of the short cycles of length 4 these decoding algorithms provide significant coding gains over the standard idbp using either the sum product or the min sum algorithms

iterative list decoding of some ldpc codes we present an iterative list decoding algorithm for low density parity check ldpc codes in particular we apply this decoder to a class of ldpc codes from finite geometries and show that the 73 45 10 projective geometry code can be maximum likelihood ml decoded with low complexity moreover the list decoding approach enables us to give a theoretical analysis of the performance we also consider list bit flipping bf decoding of longer ldpc codes

iterative decoding algorithms for a class of non binary two step majority logic decodable cyclic codes this paper presents two iterative decoding algorithms for a class of non binary two step majority logic nb ts mlg decodable cyclic codes a partial parallel decoding scheme is also introduced to provide a balanced trade off between decoding speed and storage requirements unlike non binary one step mlg decodable cyclic codes the tanner graphs of which are 4 cycle free nb ts mlg decodable cyclic codes contain a large number of short cycles of length 4 which tend to degrade decoding performance the proposed algorithms utilize the orthogonal structure of the parity check matrices of the codes to resolve the degrading effects of the short cycles of length 4 simulation results demonstrate that the nb ts mlg decodable cyclic codes decoded with the proposed algorithms offer coding gains as much as 2 5 db over reed solomon codes of the same lengths and rates decoded with either hard decision or algebraic soft decision decoding

unveiling turbo codes some results on parallel concatenated coding schemes a parallel concatenated coding scheme consists of two simple constituent systematic encoders linked by an interleaver the input bits to the first encoder are scrambled by the interleaver before entering the second encoder the codeword of the parallel concatenated code consists of the input bits to the first encoder followed by the parity check bits of both encoders this construction can be generalized to any number of constituent codes parallel concatenated schemes employing two convolutional codes as constituent codes in connection with an iterative decoding algorithm of complexity comparable to that of the constituent codes have been previously shown to yield remarkable coding gains close to theoretical limits they have been named and are known as turbo codes we propose a method to evaluate an upper bound to the bit error probability of a parallel concatenated coding scheme averaged over all interleavers of a given length the analytical bounding technique is then used to shed some light on some crucial questions which have been floating around in the communications community since the proposal of turbo codes

gradient descent bit flipping algorithms for decoding ldpc codes a novel class of bit flipping bf algorithm for decoding low density parity check ldpc codes is presented the proposed algorithms which are referred to as gradient descent bit flipping gdbf algorithms can be regarded as simplified gradient descent algorithms the proposed algorithms exhibit better decoding performance than known bf algorithms such as the weighted bf algorithm or the modified weighted bf algorithm for several ldpc codes

design of efficiently encodable moderate length high rate irregular ldpc codes this paper presents a new class of irregular low density parity check ldpc codes of moderate length 10 sup 3 spl les n spl les 10 sup 4 and high rate r spl ges 3 4 codes in this class admit low complexity encoding and have lower error rate floors than other irregular ldpc code design approaches it is also shown that this class of ldpc codes is equivalent to a class of systematic serial turbo codes and is an extension of irregular repeat accumulate codes a code design algorithm based on the combination of density evolution and differential evolution optimization with a modified cost function is presented moderate length high rate codes with no error rate floors down to a bit error rate of 10 sup 9 are presented although our focus is on moderate length high rate codes the proposed coding scheme is applicable to irregular ldpc codes with other lengths and rates

an improved decoding algorithm for finite geometry ldpc codes in this letter an improved bit flipping decoding algorithm for high rate finite geometry low density parity check fg ldpc codes is proposed both improvement in performance and reduction in decoding delay are observed by flipping multiple bits in each iteration our studies show that the proposed algorithm achieves an appealing tradeoff between performance and complexity for fg ldpc codes

a unified approach to the construction of binary and nonbinary quasi cyclic ldpc codes based on finite fields a unified approach for constructing binary and nonbinary quasi cyclic ldpc codes under a single framework is presented six classes of binary and nonbinary quasi cyclic ldpc codes are constructed based on primitive elements additive subgroups and cyclic subgroups of finite fields numerical results show that the codes constructed perform well over the awgn channel with iterative decoding

reduced complexity decoding of ldpc codes various log likelihood ratio based belief propagation llr bp decoding algorithms and their reduced complexity derivatives for low density parity check ldpc codes are presented numerically accurate representations of the check node update computation used in llr bp decoding are described furthermore approximate representations of the decoding computations are shown to achieve a reduction in complexity by simplifying the check node update or symbol node update or both in particular two main approaches for simplified check node updates are presented that are based on the so called min sum approximation coupled with either a normalization term or an additive offset term density evolution is used to analyze the performance of these decoding algorithms to determine the optimum values of the key parameters and to evaluate finite quantization effects simulation results show that these reduced complexity decoding algorithms for ldpc codes achieve a performance very close to that of the bp algorithm the unified treatment of decoding techniques for ldpc codes presented here provides flexibility in selecting the appropriate scheme from performance latency computational complexity and memory requirement perspectives