The Lanczos and Conjugate Gradient Algorithms

The Lanczos and Conjugate Gradient Algorithms

Author: Gerard Meurant

Publisher: SIAM

Published: 2006-01-01

Total Pages: 380

ISBN-13: 9780898718140

DOWNLOAD EBOOK

The Lanczos and conjugate gradient (CG) algorithms are fascinating numerical algorithms. This book presents the most comprehensive discussion to date of the use of these methods for computing eigenvalues and solving linear systems in both exact and floating point arithmetic. The author synthesizes the research done over the past 30 years, describing and explaining the "average" behavior of these methods and providing new insight into their properties in finite precision. Many examples are given that show significant results obtained by researchers in the field. The author emphasizes how both algorithms can be used efficiently in finite precision arithmetic, regardless of the growth of rounding errors that occurs. He details the mathematical properties of both algorithms and demonstrates how the CG algorithm is derived from the Lanczos algorithm. Loss of orthogonality involved with using the Lanczos algorithm, ways to improve the maximum attainable accuracy of CG computations, and what modifications need to be made when the CG method is used with a preconditioner are addressed.


Book Synopsis The Lanczos and Conjugate Gradient Algorithms by : Gerard Meurant

Download or read book The Lanczos and Conjugate Gradient Algorithms written by Gerard Meurant and published by SIAM. This book was released on 2006-01-01 with total page 380 pages. Available in PDF, EPUB and Kindle. Book excerpt: The Lanczos and conjugate gradient (CG) algorithms are fascinating numerical algorithms. This book presents the most comprehensive discussion to date of the use of these methods for computing eigenvalues and solving linear systems in both exact and floating point arithmetic. The author synthesizes the research done over the past 30 years, describing and explaining the "average" behavior of these methods and providing new insight into their properties in finite precision. Many examples are given that show significant results obtained by researchers in the field. The author emphasizes how both algorithms can be used efficiently in finite precision arithmetic, regardless of the growth of rounding errors that occurs. He details the mathematical properties of both algorithms and demonstrates how the CG algorithm is derived from the Lanczos algorithm. Loss of orthogonality involved with using the Lanczos algorithm, ways to improve the maximum attainable accuracy of CG computations, and what modifications need to be made when the CG method is used with a preconditioner are addressed.


Conjugate Gradient Algorithms in Nonconvex Optimization

Conjugate Gradient Algorithms in Nonconvex Optimization

Author: Radoslaw Pytlak

Publisher: Springer Science & Business Media

Published: 2008-11-18

Total Pages: 493

ISBN-13: 354085634X

DOWNLOAD EBOOK

This book details algorithms for large-scale unconstrained and bound constrained optimization. It shows optimization techniques from a conjugate gradient algorithm perspective as well as methods of shortest residuals, which have been developed by the author.


Book Synopsis Conjugate Gradient Algorithms in Nonconvex Optimization by : Radoslaw Pytlak

Download or read book Conjugate Gradient Algorithms in Nonconvex Optimization written by Radoslaw Pytlak and published by Springer Science & Business Media. This book was released on 2008-11-18 with total page 493 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book details algorithms for large-scale unconstrained and bound constrained optimization. It shows optimization techniques from a conjugate gradient algorithm perspective as well as methods of shortest residuals, which have been developed by the author.


Conjugate Gradient Algorithms and Finite Element Methods

Conjugate Gradient Algorithms and Finite Element Methods

Author: Michal Krizek

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 405

ISBN-13: 3642185606

DOWNLOAD EBOOK

The position taken in this collection of pedagogically written essays is that conjugate gradient algorithms and finite element methods complement each other extremely well. Via their combinations practitioners have been able to solve complicated, direct and inverse, multidemensional problems modeled by ordinary or partial differential equations and inequalities, not necessarily linear, optimal control and optimal design being part of these problems. The aim of this book is to present both methods in the context of complicated problems modeled by linear and nonlinear partial differential equations, to provide an in-depth discussion on their implementation aspects. The authors show that conjugate gradient methods and finite element methods apply to the solution of real-life problems. They address graduate students as well as experts in scientific computing.


Book Synopsis Conjugate Gradient Algorithms and Finite Element Methods by : Michal Krizek

Download or read book Conjugate Gradient Algorithms and Finite Element Methods written by Michal Krizek and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 405 pages. Available in PDF, EPUB and Kindle. Book excerpt: The position taken in this collection of pedagogically written essays is that conjugate gradient algorithms and finite element methods complement each other extremely well. Via their combinations practitioners have been able to solve complicated, direct and inverse, multidemensional problems modeled by ordinary or partial differential equations and inequalities, not necessarily linear, optimal control and optimal design being part of these problems. The aim of this book is to present both methods in the context of complicated problems modeled by linear and nonlinear partial differential equations, to provide an in-depth discussion on their implementation aspects. The authors show that conjugate gradient methods and finite element methods apply to the solution of real-life problems. They address graduate students as well as experts in scientific computing.


Fitting Linear Models

Fitting Linear Models

Author: A. McIntosh

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 208

ISBN-13: 1461257522

DOWNLOAD EBOOK

The increasing power and decreasing price of smalI computers, especialIy "personal" computers, has made them increasingly popular in statistical analysis. The day may not be too far off when every statistician has on his or her desktop computing power on a par with the large mainframe computers of 15 or 20 years ago. These same factors make it relatively easy to acquire and manipulate large quantities of data, and statisticians can expect a corresponding increase in the size of the datasets that they must analyze. Unfortunately, because of constraints imposed by architecture, size or price, these smalI computers do not possess the main memory of their large cousins. Thus, there is a growing need for algorithms that are sufficiently economical of space to permit statistical analysis on smalI computers. One area of analysis where there is a need for algorithms that are economical of space is in the fitting of linear models.


Book Synopsis Fitting Linear Models by : A. McIntosh

Download or read book Fitting Linear Models written by A. McIntosh and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 208 pages. Available in PDF, EPUB and Kindle. Book excerpt: The increasing power and decreasing price of smalI computers, especialIy "personal" computers, has made them increasingly popular in statistical analysis. The day may not be too far off when every statistician has on his or her desktop computing power on a par with the large mainframe computers of 15 or 20 years ago. These same factors make it relatively easy to acquire and manipulate large quantities of data, and statisticians can expect a corresponding increase in the size of the datasets that they must analyze. Unfortunately, because of constraints imposed by architecture, size or price, these smalI computers do not possess the main memory of their large cousins. Thus, there is a growing need for algorithms that are sufficiently economical of space to permit statistical analysis on smalI computers. One area of analysis where there is a need for algorithms that are economical of space is in the fitting of linear models.


The Symmetric Eigenvalue Problem

The Symmetric Eigenvalue Problem

Author: Beresford N. Parlett

Publisher: SIAM

Published: 1998-01-01

Total Pages: 422

ISBN-13: 9781611971163

DOWNLOAD EBOOK

According to Parlett, "Vibrations are everywhere, and so too are the eigenvalues associated with them. As mathematical models invade more and more disciplines, we can anticipate a demand for eigenvalue calculations in an ever richer variety of contexts." Anyone who performs these calculations will welcome the reprinting of Parlett's book (originally published in 1980). In this unabridged, amended version, Parlett covers aspects of the problem that are not easily found elsewhere. The chapter titles convey the scope of the material succinctly. The aim of the book is to present mathematical knowledge that is needed in order to understand the art of computing eigenvalues of real symmetric matrices, either all of them or only a few. The author explains why the selected information really matters and he is not shy about making judgments. The commentary is lively but the proofs are terse. The first nine chapters are based on a matrix on which it is possible to make similarity transformations explicitly. The only source of error is inexact arithmetic. The last five chapters turn to large sparse matrices and the task of making approximations and judging them.


Book Synopsis The Symmetric Eigenvalue Problem by : Beresford N. Parlett

Download or read book The Symmetric Eigenvalue Problem written by Beresford N. Parlett and published by SIAM. This book was released on 1998-01-01 with total page 422 pages. Available in PDF, EPUB and Kindle. Book excerpt: According to Parlett, "Vibrations are everywhere, and so too are the eigenvalues associated with them. As mathematical models invade more and more disciplines, we can anticipate a demand for eigenvalue calculations in an ever richer variety of contexts." Anyone who performs these calculations will welcome the reprinting of Parlett's book (originally published in 1980). In this unabridged, amended version, Parlett covers aspects of the problem that are not easily found elsewhere. The chapter titles convey the scope of the material succinctly. The aim of the book is to present mathematical knowledge that is needed in order to understand the art of computing eigenvalues of real symmetric matrices, either all of them or only a few. The author explains why the selected information really matters and he is not shy about making judgments. The commentary is lively but the proofs are terse. The first nine chapters are based on a matrix on which it is possible to make similarity transformations explicitly. The only source of error is inexact arithmetic. The last five chapters turn to large sparse matrices and the task of making approximations and judging them.


Error Norm Estimation in the Conjugate Gradient Algorithm

Error Norm Estimation in the Conjugate Gradient Algorithm

Author: Gérard Meurant

Publisher: SIAM

Published: 2024-01-30

Total Pages: 138

ISBN-13: 161197786X

DOWNLOAD EBOOK

The conjugate gradient (CG) algorithm is almost always the iterative method of choice for solving linear systems with symmetric positive definite matrices. This book describes and analyzes techniques based on Gauss quadrature rules to cheaply compute bounds on norms of the error. The techniques can be used to derive reliable stopping criteria. How to compute estimates of the smallest and largest eigenvalues during CG iterations is also shown. The algorithms are illustrated by many numerical experiments, and they can be easily incorporated into existing CG codes. The book is intended for those in academia and industry who use the conjugate gradient algorithm, including the many branches of science and engineering in which symmetric linear systems have to be solved.


Book Synopsis Error Norm Estimation in the Conjugate Gradient Algorithm by : Gérard Meurant

Download or read book Error Norm Estimation in the Conjugate Gradient Algorithm written by Gérard Meurant and published by SIAM. This book was released on 2024-01-30 with total page 138 pages. Available in PDF, EPUB and Kindle. Book excerpt: The conjugate gradient (CG) algorithm is almost always the iterative method of choice for solving linear systems with symmetric positive definite matrices. This book describes and analyzes techniques based on Gauss quadrature rules to cheaply compute bounds on norms of the error. The techniques can be used to derive reliable stopping criteria. How to compute estimates of the smallest and largest eigenvalues during CG iterations is also shown. The algorithms are illustrated by many numerical experiments, and they can be easily incorporated into existing CG codes. The book is intended for those in academia and industry who use the conjugate gradient algorithm, including the many branches of science and engineering in which symmetric linear systems have to be solved.


Matrices, Moments and Quadrature with Applications

Matrices, Moments and Quadrature with Applications

Author: Gene H. Golub

Publisher: Princeton University Press

Published: 2009-12-07

Total Pages: 376

ISBN-13: 1400833884

DOWNLOAD EBOOK

This computationally oriented book describes and explains the mathematical relationships among matrices, moments, orthogonal polynomials, quadrature rules, and the Lanczos and conjugate gradient algorithms. The book bridges different mathematical areas to obtain algorithms to estimate bilinear forms involving two vectors and a function of the matrix. The first part of the book provides the necessary mathematical background and explains the theory. The second part describes the applications and gives numerical examples of the algorithms and techniques developed in the first part. Applications addressed in the book include computing elements of functions of matrices; obtaining estimates of the error norm in iterative methods for solving linear systems and computing parameters in least squares and total least squares; and solving ill-posed problems using Tikhonov regularization. This book will interest researchers in numerical linear algebra and matrix computations, as well as scientists and engineers working on problems involving computation of bilinear forms.


Book Synopsis Matrices, Moments and Quadrature with Applications by : Gene H. Golub

Download or read book Matrices, Moments and Quadrature with Applications written by Gene H. Golub and published by Princeton University Press. This book was released on 2009-12-07 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This computationally oriented book describes and explains the mathematical relationships among matrices, moments, orthogonal polynomials, quadrature rules, and the Lanczos and conjugate gradient algorithms. The book bridges different mathematical areas to obtain algorithms to estimate bilinear forms involving two vectors and a function of the matrix. The first part of the book provides the necessary mathematical background and explains the theory. The second part describes the applications and gives numerical examples of the algorithms and techniques developed in the first part. Applications addressed in the book include computing elements of functions of matrices; obtaining estimates of the error norm in iterative methods for solving linear systems and computing parameters in least squares and total least squares; and solving ill-posed problems using Tikhonov regularization. This book will interest researchers in numerical linear algebra and matrix computations, as well as scientists and engineers working on problems involving computation of bilinear forms.


Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems

Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems

Author: ENGELI

Publisher: Birkhäuser

Published: 2012-12-06

Total Pages: 107

ISBN-13: 3034872240

DOWNLOAD EBOOK


Book Synopsis Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems by : ENGELI

Download or read book Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems written by ENGELI and published by Birkhäuser. This book was released on 2012-12-06 with total page 107 pages. Available in PDF, EPUB and Kindle. Book excerpt:


Linear and Nonlinear Conjugate Gradient-related Methods

Linear and Nonlinear Conjugate Gradient-related Methods

Author: Loyce M. Adams

Publisher: SIAM

Published: 1996-01-01

Total Pages: 186

ISBN-13: 9780898713763

DOWNLOAD EBOOK

Proceedings of the AMS-IMS-SIAM Summer Research Conference held at the University of Washington, July 1995.


Book Synopsis Linear and Nonlinear Conjugate Gradient-related Methods by : Loyce M. Adams

Download or read book Linear and Nonlinear Conjugate Gradient-related Methods written by Loyce M. Adams and published by SIAM. This book was released on 1996-01-01 with total page 186 pages. Available in PDF, EPUB and Kindle. Book excerpt: Proceedings of the AMS-IMS-SIAM Summer Research Conference held at the University of Washington, July 1995.


Iterative Methods for Sparse Linear Systems

Iterative Methods for Sparse Linear Systems

Author: Yousef Saad

Publisher: SIAM

Published: 2003-04-01

Total Pages: 537

ISBN-13: 0898715342

DOWNLOAD EBOOK

Mathematics of Computing -- General.


Book Synopsis Iterative Methods for Sparse Linear Systems by : Yousef Saad

Download or read book Iterative Methods for Sparse Linear Systems written by Yousef Saad and published by SIAM. This book was released on 2003-04-01 with total page 537 pages. Available in PDF, EPUB and Kindle. Book excerpt: Mathematics of Computing -- General.