An Extended Babai Method for Estimating Linear Model Based Integer Parameters

Estimating the integer parameter vector in a linear model with additive Gaussian noise is considered. First, Babai’s nearest plane method is extended to a more general estimation method in order to give a better estimator, and its computational cost is analyzed. Then, lower and upper bounds on the success probability of the extended Babai estimator are derived. Based on this theory, a specific (K,L) extended Babai estimation method is proposed, where K and L are two parameters. Numerical results confirm the theoretical findings and show the advantages of the (K,L) extended Babai method over an existing one.