Sparse Polynomial Optimization: Theory And Practice

Sparse Polynomial Optimization: Theory And Practice

Author: Victor Magron

Publisher: World Scientific

Published: 2023-04-25

Total Pages: 223

ISBN-13: 1800612966

DOWNLOAD EBOOK

Many applications, including computer vision, computer arithmetic, deep learning, entanglement in quantum information, graph theory and energy networks, can be successfully tackled within the framework of polynomial optimization, an emerging field with growing research efforts in the last two decades. One key advantage of these techniques is their ability to model a wide range of problems using optimization formulations. Polynomial optimization heavily relies on the moment-sums of squares (moment-SOS) approach proposed by Lasserre, which provides certificates for positive polynomials. On the practical side, however, there is 'no free lunch' and such optimization methods usually encompass severe scalability issues. Fortunately, for many applications, including the ones formerly mentioned, we can look at the problem in the eyes and exploit the inherent data structure arising from the cost and constraints describing the problem.This book presents several research efforts to resolve this scientific challenge with important computational implications. It provides the development of alternative optimization schemes that scale well in terms of computational complexity, at least in some identified class of problems. It also features a unified modeling framework to handle a wide range of applications involving both commutative and noncommutative variables, and to solve concretely large-scale instances. Readers will find a practical section dedicated to the use of available open-source software libraries.This interdisciplinary monograph is essential reading for students, researchers and professionals interested in solving optimization problems with polynomial input data.


Book Synopsis Sparse Polynomial Optimization: Theory And Practice by : Victor Magron

Download or read book Sparse Polynomial Optimization: Theory And Practice written by Victor Magron and published by World Scientific. This book was released on 2023-04-25 with total page 223 pages. Available in PDF, EPUB and Kindle. Book excerpt: Many applications, including computer vision, computer arithmetic, deep learning, entanglement in quantum information, graph theory and energy networks, can be successfully tackled within the framework of polynomial optimization, an emerging field with growing research efforts in the last two decades. One key advantage of these techniques is their ability to model a wide range of problems using optimization formulations. Polynomial optimization heavily relies on the moment-sums of squares (moment-SOS) approach proposed by Lasserre, which provides certificates for positive polynomials. On the practical side, however, there is 'no free lunch' and such optimization methods usually encompass severe scalability issues. Fortunately, for many applications, including the ones formerly mentioned, we can look at the problem in the eyes and exploit the inherent data structure arising from the cost and constraints describing the problem.This book presents several research efforts to resolve this scientific challenge with important computational implications. It provides the development of alternative optimization schemes that scale well in terms of computational complexity, at least in some identified class of problems. It also features a unified modeling framework to handle a wide range of applications involving both commutative and noncommutative variables, and to solve concretely large-scale instances. Readers will find a practical section dedicated to the use of available open-source software libraries.This interdisciplinary monograph is essential reading for students, researchers and professionals interested in solving optimization problems with polynomial input data.


Polynomial Optimization, Moments, and Applications

Polynomial Optimization, Moments, and Applications

Author: Michal Kočvara

Publisher: Springer Nature

Published: 2024-01-28

Total Pages: 274

ISBN-13: 3031386590

DOWNLOAD EBOOK

Polynomial optimization is a fascinating field of study that has revolutionized the way we approach nonlinear problems described by polynomial constraints. The applications of this field range from production planning processes to transportation, energy consumption, and resource control. This introductory book explores the latest research developments in polynomial optimization, presenting the results of cutting-edge interdisciplinary work conducted by the European network POEMA. For the past four years, experts from various fields, including algebraists, geometers, computer scientists, and industrial actors, have collaborated in this network to create new methods that go beyond traditional paradigms of mathematical optimization. By exploiting new advances in algebra and convex geometry, these innovative approaches have resulted in significant scientific and technological advancements. This book aims to make these exciting developments accessible to a wider audience by gathering high-quality chapters on these hot topics. Aimed at both aspiring and established researchers, as well as industry professionals, this book will be an invaluable resource for anyone interested in polynomial optimization and its potential for real-world applications.


Book Synopsis Polynomial Optimization, Moments, and Applications by : Michal Kočvara

Download or read book Polynomial Optimization, Moments, and Applications written by Michal Kočvara and published by Springer Nature. This book was released on 2024-01-28 with total page 274 pages. Available in PDF, EPUB and Kindle. Book excerpt: Polynomial optimization is a fascinating field of study that has revolutionized the way we approach nonlinear problems described by polynomial constraints. The applications of this field range from production planning processes to transportation, energy consumption, and resource control. This introductory book explores the latest research developments in polynomial optimization, presenting the results of cutting-edge interdisciplinary work conducted by the European network POEMA. For the past four years, experts from various fields, including algebraists, geometers, computer scientists, and industrial actors, have collaborated in this network to create new methods that go beyond traditional paradigms of mathematical optimization. By exploiting new advances in algebra and convex geometry, these innovative approaches have resulted in significant scientific and technological advancements. This book aims to make these exciting developments accessible to a wider audience by gathering high-quality chapters on these hot topics. Aimed at both aspiring and established researchers, as well as industry professionals, this book will be an invaluable resource for anyone interested in polynomial optimization and its potential for real-world applications.


Sparse Polynomial Approximation of High-Dimensional Functions

Sparse Polynomial Approximation of High-Dimensional Functions

Author: Ben Adcock

Publisher: SIAM

Published: 2022-02-16

Total Pages: 310

ISBN-13: 161197688X

DOWNLOAD EBOOK

Over seventy years ago, Richard Bellman coined the term “the curse of dimensionality” to describe phenomena and computational challenges that arise in high dimensions. These challenges, in tandem with the ubiquity of high-dimensional functions in real-world applications, have led to a lengthy, focused research effort on high-dimensional approximation—that is, the development of methods for approximating functions of many variables accurately and efficiently from data. This book provides an in-depth treatment of one of the latest installments in this long and ongoing story: sparse polynomial approximation methods. These methods have emerged as useful tools for various high-dimensional approximation tasks arising in a range of applications in computational science and engineering. It begins with a comprehensive overview of best s-term polynomial approximation theory for holomorphic, high-dimensional functions, as well as a detailed survey of applications to parametric differential equations. It then describes methods for computing sparse polynomial approximations, focusing on least squares and compressed sensing techniques. Sparse Polynomial Approximation of High-Dimensional Functions presents the first comprehensive and unified treatment of polynomial approximation techniques that can mitigate the curse of dimensionality in high-dimensional approximation, including least squares and compressed sensing. It develops main concepts in a mathematically rigorous manner, with full proofs given wherever possible, and it contains many numerical examples, each accompanied by downloadable code. The authors provide an extensive bibliography of over 350 relevant references, with an additional annotated bibliography available on the book’s companion website (www.sparse-hd-book.com). This text is aimed at graduate students, postdoctoral fellows, and researchers in mathematics, computer science, and engineering who are interested in high-dimensional polynomial approximation techniques.


Book Synopsis Sparse Polynomial Approximation of High-Dimensional Functions by : Ben Adcock

Download or read book Sparse Polynomial Approximation of High-Dimensional Functions written by Ben Adcock and published by SIAM. This book was released on 2022-02-16 with total page 310 pages. Available in PDF, EPUB and Kindle. Book excerpt: Over seventy years ago, Richard Bellman coined the term “the curse of dimensionality” to describe phenomena and computational challenges that arise in high dimensions. These challenges, in tandem with the ubiquity of high-dimensional functions in real-world applications, have led to a lengthy, focused research effort on high-dimensional approximation—that is, the development of methods for approximating functions of many variables accurately and efficiently from data. This book provides an in-depth treatment of one of the latest installments in this long and ongoing story: sparse polynomial approximation methods. These methods have emerged as useful tools for various high-dimensional approximation tasks arising in a range of applications in computational science and engineering. It begins with a comprehensive overview of best s-term polynomial approximation theory for holomorphic, high-dimensional functions, as well as a detailed survey of applications to parametric differential equations. It then describes methods for computing sparse polynomial approximations, focusing on least squares and compressed sensing techniques. Sparse Polynomial Approximation of High-Dimensional Functions presents the first comprehensive and unified treatment of polynomial approximation techniques that can mitigate the curse of dimensionality in high-dimensional approximation, including least squares and compressed sensing. It develops main concepts in a mathematically rigorous manner, with full proofs given wherever possible, and it contains many numerical examples, each accompanied by downloadable code. The authors provide an extensive bibliography of over 350 relevant references, with an additional annotated bibliography available on the book’s companion website (www.sparse-hd-book.com). This text is aimed at graduate students, postdoctoral fellows, and researchers in mathematics, computer science, and engineering who are interested in high-dimensional polynomial approximation techniques.


Handbook on Semidefinite, Conic and Polynomial Optimization

Handbook on Semidefinite, Conic and Polynomial Optimization

Author: Miguel F. Anjos

Publisher: Springer Science & Business Media

Published: 2011-11-19

Total Pages: 955

ISBN-13: 1461407699

DOWNLOAD EBOOK

Semidefinite and conic optimization is a major and thriving research area within the optimization community. Although semidefinite optimization has been studied (under different names) since at least the 1940s, its importance grew immensely during the 1990s after polynomial-time interior-point methods for linear optimization were extended to solve semidefinite optimization problems. Since the beginning of the 21st century, not only has research into semidefinite and conic optimization continued unabated, but also a fruitful interaction has developed with algebraic geometry through the close connections between semidefinite matrices and polynomial optimization. This has brought about important new results and led to an even higher level of research activity. This Handbook on Semidefinite, Conic and Polynomial Optimization provides the reader with a snapshot of the state-of-the-art in the growing and mutually enriching areas of semidefinite optimization, conic optimization, and polynomial optimization. It contains a compendium of the recent research activity that has taken place in these thrilling areas, and will appeal to doctoral students, young graduates, and experienced researchers alike. The Handbook’s thirty-one chapters are organized into four parts: Theory, covering significant theoretical developments as well as the interactions between conic optimization and polynomial optimization; Algorithms, documenting the directions of current algorithmic development; Software, providing an overview of the state-of-the-art; Applications, dealing with the application areas where semidefinite and conic optimization has made a significant impact in recent years.


Book Synopsis Handbook on Semidefinite, Conic and Polynomial Optimization by : Miguel F. Anjos

Download or read book Handbook on Semidefinite, Conic and Polynomial Optimization written by Miguel F. Anjos and published by Springer Science & Business Media. This book was released on 2011-11-19 with total page 955 pages. Available in PDF, EPUB and Kindle. Book excerpt: Semidefinite and conic optimization is a major and thriving research area within the optimization community. Although semidefinite optimization has been studied (under different names) since at least the 1940s, its importance grew immensely during the 1990s after polynomial-time interior-point methods for linear optimization were extended to solve semidefinite optimization problems. Since the beginning of the 21st century, not only has research into semidefinite and conic optimization continued unabated, but also a fruitful interaction has developed with algebraic geometry through the close connections between semidefinite matrices and polynomial optimization. This has brought about important new results and led to an even higher level of research activity. This Handbook on Semidefinite, Conic and Polynomial Optimization provides the reader with a snapshot of the state-of-the-art in the growing and mutually enriching areas of semidefinite optimization, conic optimization, and polynomial optimization. It contains a compendium of the recent research activity that has taken place in these thrilling areas, and will appeal to doctoral students, young graduates, and experienced researchers alike. The Handbook’s thirty-one chapters are organized into four parts: Theory, covering significant theoretical developments as well as the interactions between conic optimization and polynomial optimization; Algorithms, documenting the directions of current algorithmic development; Software, providing an overview of the state-of-the-art; Applications, dealing with the application areas where semidefinite and conic optimization has made a significant impact in recent years.


Genericity In Polynomial Optimization

Genericity In Polynomial Optimization

Author: Tien Son Pham

Publisher: World Scientific

Published: 2016-12-22

Total Pages: 260

ISBN-13: 1786342235

DOWNLOAD EBOOK

In full generality, minimizing a polynomial function over a closed semi-algebraic set requires complex mathematical equations. This book explains recent developments from singularity theory and semi-algebraic geometry for studying polynomial optimization problems. Classes of generic problems are defined in a simple and elegant manner by using only the two basic (and relatively simple) notions of Newton polyhedron and non-degeneracy conditions associated with a given polynomial optimization problem. These conditions are well known in singularity theory, however, they are rarely considered within the optimization community.Explanations focus on critical points and tangencies of polynomial optimization, Hölderian error bounds for polynomial systems, Frank-Wolfe-type theorem for polynomial programs and well-posedness in polynomial optimization. It then goes on to look at optimization for the different types of polynomials. Through this text graduate students, PhD students and researchers of mathematics will be provided with the knowledge necessary to use semi-algebraic geometry in optimization.


Book Synopsis Genericity In Polynomial Optimization by : Tien Son Pham

Download or read book Genericity In Polynomial Optimization written by Tien Son Pham and published by World Scientific. This book was released on 2016-12-22 with total page 260 pages. Available in PDF, EPUB and Kindle. Book excerpt: In full generality, minimizing a polynomial function over a closed semi-algebraic set requires complex mathematical equations. This book explains recent developments from singularity theory and semi-algebraic geometry for studying polynomial optimization problems. Classes of generic problems are defined in a simple and elegant manner by using only the two basic (and relatively simple) notions of Newton polyhedron and non-degeneracy conditions associated with a given polynomial optimization problem. These conditions are well known in singularity theory, however, they are rarely considered within the optimization community.Explanations focus on critical points and tangencies of polynomial optimization, Hölderian error bounds for polynomial systems, Frank-Wolfe-type theorem for polynomial programs and well-posedness in polynomial optimization. It then goes on to look at optimization for the different types of polynomials. Through this text graduate students, PhD students and researchers of mathematics will be provided with the knowledge necessary to use semi-algebraic geometry in optimization.


Optimization of Polynomials in Non-Commuting Variables

Optimization of Polynomials in Non-Commuting Variables

Author: Sabine Burgdorf

Publisher: Springer

Published: 2016-06-07

Total Pages: 118

ISBN-13: 3319333380

DOWNLOAD EBOOK

This book presents recent results on positivity and optimization of polynomials in non-commuting variables. Researchers in non-commutative algebraic geometry, control theory, system engineering, optimization, quantum physics and information science will find the unified notation and mixture of algebraic geometry and mathematical programming useful. Theoretical results are matched with algorithmic considerations; several examples and information on how to use NCSOStools open source package to obtain the results provided. Results are presented on detecting the eigenvalue and trace positivity of polynomials in non-commuting variables using Newton chip method and Newton cyclic chip method, relaxations for constrained and unconstrained optimization problems, semidefinite programming formulations of the relaxations and finite convergence of the hierarchies of these relaxations, and the practical efficiency of algorithms.


Book Synopsis Optimization of Polynomials in Non-Commuting Variables by : Sabine Burgdorf

Download or read book Optimization of Polynomials in Non-Commuting Variables written by Sabine Burgdorf and published by Springer. This book was released on 2016-06-07 with total page 118 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book presents recent results on positivity and optimization of polynomials in non-commuting variables. Researchers in non-commutative algebraic geometry, control theory, system engineering, optimization, quantum physics and information science will find the unified notation and mixture of algebraic geometry and mathematical programming useful. Theoretical results are matched with algorithmic considerations; several examples and information on how to use NCSOStools open source package to obtain the results provided. Results are presented on detecting the eigenvalue and trace positivity of polynomials in non-commuting variables using Newton chip method and Newton cyclic chip method, relaxations for constrained and unconstrained optimization problems, semidefinite programming formulations of the relaxations and finite convergence of the hierarchies of these relaxations, and the practical efficiency of algorithms.


Integer Programming Techniques for Polynomial Optimization

Integer Programming Techniques for Polynomial Optimization

Author: Gonzalo Munoz

Publisher:

Published: 2017

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

In this dissertation, we will explore theoretical and practical Integer-Programming-based techniques for Polynomial Optimization problems. We first present a Linear Programming relaxation for the AC-OPF problem in Power Systems, a non-convex quadratic problem, and show how such relaxation can be used to develop a tractable MIP-based algorithm for the AC Transmission Switching problem. From a more theoretical perspective, and motivated by the AC-OPF problem, we study how sparsity can be exploited as a tool for analysis of the fundamental complexity of a Polynomial Optimization problem, by showing LP formulations that can efficiently approximate sparse polynomial problems. Finally, we show a computationally practical approach for constructing strong LP approximations on-the-fly, using cutting plane approaches. We will show two different frameworks that can generate cutting planes, which are based on classical methods used in Mixed-Integer Programming. Our methods mainly rely on the maturity of current MIP technology; we believe these contributions are important for the development of manageable approaches to general Polynomial Optimization problems.


Book Synopsis Integer Programming Techniques for Polynomial Optimization by : Gonzalo Munoz

Download or read book Integer Programming Techniques for Polynomial Optimization written by Gonzalo Munoz and published by . This book was released on 2017 with total page pages. Available in PDF, EPUB and Kindle. Book excerpt: In this dissertation, we will explore theoretical and practical Integer-Programming-based techniques for Polynomial Optimization problems. We first present a Linear Programming relaxation for the AC-OPF problem in Power Systems, a non-convex quadratic problem, and show how such relaxation can be used to develop a tractable MIP-based algorithm for the AC Transmission Switching problem. From a more theoretical perspective, and motivated by the AC-OPF problem, we study how sparsity can be exploited as a tool for analysis of the fundamental complexity of a Polynomial Optimization problem, by showing LP formulations that can efficiently approximate sparse polynomial problems. Finally, we show a computationally practical approach for constructing strong LP approximations on-the-fly, using cutting plane approaches. We will show two different frameworks that can generate cutting planes, which are based on classical methods used in Mixed-Integer Programming. Our methods mainly rely on the maturity of current MIP technology; we believe these contributions are important for the development of manageable approaches to general Polynomial Optimization problems.


Handbook on Semidefinite, Conic and Polynomial Optimization

Handbook on Semidefinite, Conic and Polynomial Optimization

Author: Jean B Lasserre

Publisher: Springer

Published: 2016-05-01

Total Pages: 974

ISBN-13: 9781489978035

DOWNLOAD EBOOK

This book offers the reader a snapshot of the state-of-the-art in the growing and mutually enriching areas of semidefinite optimization, conic optimization and polynomial optimization. It covers theory, algorithms, software and applications.


Book Synopsis Handbook on Semidefinite, Conic and Polynomial Optimization by : Jean B Lasserre

Download or read book Handbook on Semidefinite, Conic and Polynomial Optimization written by Jean B Lasserre and published by Springer. This book was released on 2016-05-01 with total page 974 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book offers the reader a snapshot of the state-of-the-art in the growing and mutually enriching areas of semidefinite optimization, conic optimization and polynomial optimization. It covers theory, algorithms, software and applications.


An Introduction to Polynomial and Semi-Algebraic Optimization

An Introduction to Polynomial and Semi-Algebraic Optimization

Author: Jean Bernard Lasserre

Publisher: Cambridge University Press

Published: 2015-02-19

Total Pages: 355

ISBN-13: 1316240398

DOWNLOAD EBOOK

This is the first comprehensive introduction to the powerful moment approach for solving global optimization problems (and some related problems) described by polynomials (and even semi-algebraic functions). In particular, the author explains how to use relatively recent results from real algebraic geometry to provide a systematic numerical scheme for computing the optimal value and global minimizers. Indeed, among other things, powerful positivity certificates from real algebraic geometry allow one to define an appropriate hierarchy of semidefinite (SOS) relaxations or LP relaxations whose optimal values converge to the global minimum. Several extensions to related optimization problems are also described. Graduate students, engineers and researchers entering the field can use this book to understand, experiment with and master this new approach through the simple worked examples provided.


Book Synopsis An Introduction to Polynomial and Semi-Algebraic Optimization by : Jean Bernard Lasserre

Download or read book An Introduction to Polynomial and Semi-Algebraic Optimization written by Jean Bernard Lasserre and published by Cambridge University Press. This book was released on 2015-02-19 with total page 355 pages. Available in PDF, EPUB and Kindle. Book excerpt: This is the first comprehensive introduction to the powerful moment approach for solving global optimization problems (and some related problems) described by polynomials (and even semi-algebraic functions). In particular, the author explains how to use relatively recent results from real algebraic geometry to provide a systematic numerical scheme for computing the optimal value and global minimizers. Indeed, among other things, powerful positivity certificates from real algebraic geometry allow one to define an appropriate hierarchy of semidefinite (SOS) relaxations or LP relaxations whose optimal values converge to the global minimum. Several extensions to related optimization problems are also described. Graduate students, engineers and researchers entering the field can use this book to understand, experiment with and master this new approach through the simple worked examples provided.


Moment and Polynomial Optimization

Moment and Polynomial Optimization

Author: Jiawang Nie

Publisher: SIAM

Published: 2023-06-15

Total Pages: 484

ISBN-13: 1611977606

DOWNLOAD EBOOK

Moment and polynomial optimization is an active research field used to solve difficult questions in many areas, including global optimization, tensor computation, saddle points, Nash equilibrium, and bilevel programs, and it has many applications. The author synthesizes current research and applications, providing a systematic introduction to theory and methods, a comprehensive approach for extracting optimizers and solving truncated moment problems, and a creative methodology for using optimality conditions to construct tight Moment-SOS relaxations. This book is intended for applied mathematicians, engineers, and researchers entering the field. It can be used as a textbook for graduate students in courses on convex optimization, polynomial optimization, and matrix and tensor optimization.


Book Synopsis Moment and Polynomial Optimization by : Jiawang Nie

Download or read book Moment and Polynomial Optimization written by Jiawang Nie and published by SIAM. This book was released on 2023-06-15 with total page 484 pages. Available in PDF, EPUB and Kindle. Book excerpt: Moment and polynomial optimization is an active research field used to solve difficult questions in many areas, including global optimization, tensor computation, saddle points, Nash equilibrium, and bilevel programs, and it has many applications. The author synthesizes current research and applications, providing a systematic introduction to theory and methods, a comprehensive approach for extracting optimizers and solving truncated moment problems, and a creative methodology for using optimality conditions to construct tight Moment-SOS relaxations. This book is intended for applied mathematicians, engineers, and researchers entering the field. It can be used as a textbook for graduate students in courses on convex optimization, polynomial optimization, and matrix and tensor optimization.