Lanczos Algorithm and Conjugate Gradient

Abstract

We review results from the literature on the conjugate gradient algorithm for solving symmetric positive definite linear systems and the related Lanczos algorithm. We derive the conjugate gradient algorithm from the more general conjugate directionmethod, using projectors. We establish error bounds using exact arithmetic theory and also discuss what can happen when floating-point arithmetic is used. We present numerical experiments to illustrate this behavior.