Bayesian Optimization and Data Science

Bayesian Optimization and Data Science

Author: Francesco Archetti

Publisher: Springer

Published: 2019-10-07

Total Pages: 126

ISBN-13: 9783030244934

DOWNLOAD EBOOK

This volume brings together the main results in the field of Bayesian Optimization (BO), focusing on the last ten years and showing how, on the basic framework, new methods have been specialized to solve emerging problems from machine learning, artificial intelligence, and system optimization. It also analyzes the software resources available for BO and a few selected application areas. Some areas for which new results are shown include constrained optimization, safe optimization, and applied mathematics, specifically BO's use in solving difficult nonlinear mixed integer problems. The book will help bring readers to a full understanding of the basic Bayesian Optimization framework and gain an appreciation of its potential for emerging application areas. It will be of particular interest to the data science, computer science, optimization, and engineering communities.


Book Synopsis Bayesian Optimization and Data Science by : Francesco Archetti

Download or read book Bayesian Optimization and Data Science written by Francesco Archetti and published by Springer. This book was released on 2019-10-07 with total page 126 pages. Available in PDF, EPUB and Kindle. Book excerpt: This volume brings together the main results in the field of Bayesian Optimization (BO), focusing on the last ten years and showing how, on the basic framework, new methods have been specialized to solve emerging problems from machine learning, artificial intelligence, and system optimization. It also analyzes the software resources available for BO and a few selected application areas. Some areas for which new results are shown include constrained optimization, safe optimization, and applied mathematics, specifically BO's use in solving difficult nonlinear mixed integer problems. The book will help bring readers to a full understanding of the basic Bayesian Optimization framework and gain an appreciation of its potential for emerging application areas. It will be of particular interest to the data science, computer science, optimization, and engineering communities.


Bayesian Optimization with Application to Computer Experiments

Bayesian Optimization with Application to Computer Experiments

Author: Tony Pourmohamad

Publisher: Springer Nature

Published: 2021-10-04

Total Pages: 113

ISBN-13: 3030824586

DOWNLOAD EBOOK

This book introduces readers to Bayesian optimization, highlighting advances in the field and showcasing its successful applications to computer experiments. R code is available as online supplementary material for most included examples, so that readers can better comprehend and reproduce methods. Compact and accessible, the volume is broken down into four chapters. Chapter 1 introduces the reader to the topic of computer experiments; it includes a variety of examples across many industries. Chapter 2 focuses on the task of surrogate model building and contains a mix of several different surrogate models that are used in the computer modeling and machine learning communities. Chapter 3 introduces the core concepts of Bayesian optimization and discusses unconstrained optimization. Chapter 4 moves on to constrained optimization, and showcases some of the most novel methods found in the field. This will be a useful companion to researchers and practitioners working with computer experiments and computer modeling. Additionally, readers with a background in machine learning but minimal background in computer experiments will find this book an interesting case study of the applicability of Bayesian optimization outside the realm of machine learning.


Book Synopsis Bayesian Optimization with Application to Computer Experiments by : Tony Pourmohamad

Download or read book Bayesian Optimization with Application to Computer Experiments written by Tony Pourmohamad and published by Springer Nature. This book was released on 2021-10-04 with total page 113 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book introduces readers to Bayesian optimization, highlighting advances in the field and showcasing its successful applications to computer experiments. R code is available as online supplementary material for most included examples, so that readers can better comprehend and reproduce methods. Compact and accessible, the volume is broken down into four chapters. Chapter 1 introduces the reader to the topic of computer experiments; it includes a variety of examples across many industries. Chapter 2 focuses on the task of surrogate model building and contains a mix of several different surrogate models that are used in the computer modeling and machine learning communities. Chapter 3 introduces the core concepts of Bayesian optimization and discusses unconstrained optimization. Chapter 4 moves on to constrained optimization, and showcases some of the most novel methods found in the field. This will be a useful companion to researchers and practitioners working with computer experiments and computer modeling. Additionally, readers with a background in machine learning but minimal background in computer experiments will find this book an interesting case study of the applicability of Bayesian optimization outside the realm of machine learning.


Bayesian Optimization for Materials Science

Bayesian Optimization for Materials Science

Author: Daniel Packwood

Publisher: Springer

Published: 2017-10-04

Total Pages: 42

ISBN-13: 9811067813

DOWNLOAD EBOOK

This book provides a short and concise introduction to Bayesian optimization specifically for experimental and computational materials scientists. After explaining the basic idea behind Bayesian optimization and some applications to materials science in Chapter 1, the mathematical theory of Bayesian optimization is outlined in Chapter 2. Finally, Chapter 3 discusses an application of Bayesian optimization to a complicated structure optimization problem in computational surface science.Bayesian optimization is a promising global optimization technique that originates in the field of machine learning and is starting to gain attention in materials science. For the purpose of materials design, Bayesian optimization can be used to predict new materials with novel properties without extensive screening of candidate materials. For the purpose of computational materials science, Bayesian optimization can be incorporated into first-principles calculations to perform efficient, global structure optimizations. While research in these directions has been reported in high-profile journals, until now there has been no textbook aimed specifically at materials scientists who wish to incorporate Bayesian optimization into their own research. This book will be accessible to researchers and students in materials science who have a basic background in calculus and linear algebra.


Book Synopsis Bayesian Optimization for Materials Science by : Daniel Packwood

Download or read book Bayesian Optimization for Materials Science written by Daniel Packwood and published by Springer. This book was released on 2017-10-04 with total page 42 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a short and concise introduction to Bayesian optimization specifically for experimental and computational materials scientists. After explaining the basic idea behind Bayesian optimization and some applications to materials science in Chapter 1, the mathematical theory of Bayesian optimization is outlined in Chapter 2. Finally, Chapter 3 discusses an application of Bayesian optimization to a complicated structure optimization problem in computational surface science.Bayesian optimization is a promising global optimization technique that originates in the field of machine learning and is starting to gain attention in materials science. For the purpose of materials design, Bayesian optimization can be used to predict new materials with novel properties without extensive screening of candidate materials. For the purpose of computational materials science, Bayesian optimization can be incorporated into first-principles calculations to perform efficient, global structure optimizations. While research in these directions has been reported in high-profile journals, until now there has been no textbook aimed specifically at materials scientists who wish to incorporate Bayesian optimization into their own research. This book will be accessible to researchers and students in materials science who have a basic background in calculus and linear algebra.


Hierarchical Bayesian Optimization Algorithm

Hierarchical Bayesian Optimization Algorithm

Author: Martin Pelikan

Publisher: Springer Science & Business Media

Published: 2005-02

Total Pages: 194

ISBN-13: 9783540237747

DOWNLOAD EBOOK

This book provides a framework for the design of competent optimization techniques by combining advanced evolutionary algorithms with state-of-the-art machine learning techniques. The book focuses on two algorithms that replace traditional variation operators of evolutionary algorithms by learning and sampling Bayesian networks: the Bayesian optimization algorithm (BOA) and the hierarchical BOA (hBOA). BOA and hBOA are theoretically and empirically shown to provide robust and scalable solution for broad classes of nearly decomposable and hierarchical problems. A theoretical model is developed that estimates the scalability and adequate parameter settings for BOA and hBOA. The performance of BOA and hBOA is analyzed on a number of artificial problems of bounded difficulty designed to test BOA and hBOA on the boundary of their design envelope. The algorithms are also extensively tested on two interesting classes of real-world problems: MAXSAT and Ising spin glasses with periodic boundary conditions in two and three dimensions. Experimental results validate the theoretical model and confirm that BOA and hBOA provide robust and scalable solution for nearly decomposable and hierarchical problems with only little problem-specific information.


Book Synopsis Hierarchical Bayesian Optimization Algorithm by : Martin Pelikan

Download or read book Hierarchical Bayesian Optimization Algorithm written by Martin Pelikan and published by Springer Science & Business Media. This book was released on 2005-02 with total page 194 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book provides a framework for the design of competent optimization techniques by combining advanced evolutionary algorithms with state-of-the-art machine learning techniques. The book focuses on two algorithms that replace traditional variation operators of evolutionary algorithms by learning and sampling Bayesian networks: the Bayesian optimization algorithm (BOA) and the hierarchical BOA (hBOA). BOA and hBOA are theoretically and empirically shown to provide robust and scalable solution for broad classes of nearly decomposable and hierarchical problems. A theoretical model is developed that estimates the scalability and adequate parameter settings for BOA and hBOA. The performance of BOA and hBOA is analyzed on a number of artificial problems of bounded difficulty designed to test BOA and hBOA on the boundary of their design envelope. The algorithms are also extensively tested on two interesting classes of real-world problems: MAXSAT and Ising spin glasses with periodic boundary conditions in two and three dimensions. Experimental results validate the theoretical model and confirm that BOA and hBOA provide robust and scalable solution for nearly decomposable and hierarchical problems with only little problem-specific information.


Bayesian Approach to Global Optimization

Bayesian Approach to Global Optimization

Author: Jonas Mockus

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 267

ISBN-13: 9400909098

DOWNLOAD EBOOK

·Et moi ... si j'avait su comment en revcnir. One service mathematics has rendered the je o'y semis point alle.' human race. It has put common sense back Jules Verne where it beloogs. on the topmost shelf next to the dusty canister labelled 'discarded non The series is divergent; therefore we may be sense', able to do something with it. Eric T. BclI O. Heaviside Mathematics is a tool for thought. A highly necessary tool in a world where both feedback and non linearities abound. Similarly, all kinds of parts of mathematics serve as tools for other parts and for other sciences. Applying a simple rewriting rule to the quote on the right above one finds such statements as: 'One service topology has rendered mathematical physics ... '; 'One service logic has rendered com puter science .. .'; 'One service category theory has rendered mathematics .. .'. All arguably true. And all statements obtainable this way form part of the raison d'etre of this series.


Book Synopsis Bayesian Approach to Global Optimization by : Jonas Mockus

Download or read book Bayesian Approach to Global Optimization written by Jonas Mockus and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 267 pages. Available in PDF, EPUB and Kindle. Book excerpt: ·Et moi ... si j'avait su comment en revcnir. One service mathematics has rendered the je o'y semis point alle.' human race. It has put common sense back Jules Verne where it beloogs. on the topmost shelf next to the dusty canister labelled 'discarded non The series is divergent; therefore we may be sense', able to do something with it. Eric T. BclI O. Heaviside Mathematics is a tool for thought. A highly necessary tool in a world where both feedback and non linearities abound. Similarly, all kinds of parts of mathematics serve as tools for other parts and for other sciences. Applying a simple rewriting rule to the quote on the right above one finds such statements as: 'One service topology has rendered mathematical physics ... '; 'One service logic has rendered com puter science .. .'; 'One service category theory has rendered mathematics .. .'. All arguably true. And all statements obtainable this way form part of the raison d'etre of this series.


Experimentation for Engineers

Experimentation for Engineers

Author: David Sweet

Publisher: Simon and Schuster

Published: 2023-03-21

Total Pages: 246

ISBN-13: 1638356904

DOWNLOAD EBOOK

Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries. In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to: Design, run, and analyze an A/B test Break the "feedback loops" caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization Clearly define business metrics used for decision-making Identify and avoid the common pitfalls of experimentation Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions. About the book Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results. What's inside Design, run, and analyze an A/B test Break the “feedback loops” caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization About the reader For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy. About the author David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University. Table of Contents 1 Optimizing systems by experiment 2 A/B testing: Evaluating a modification to your system 3 Multi-armed bandits: Maximizing business metrics while experimenting 4 Response surface methodology: Optimizing continuous parameters 5 Contextual bandits: Making targeted decisions 6 Bayesian optimization: Automating experimental optimization 7 Managing business metrics 8 Practical considerations


Book Synopsis Experimentation for Engineers by : David Sweet

Download or read book Experimentation for Engineers written by David Sweet and published by Simon and Schuster. This book was released on 2023-03-21 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt: Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries. In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to: Design, run, and analyze an A/B test Break the "feedback loops" caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization Clearly define business metrics used for decision-making Identify and avoid the common pitfalls of experimentation Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions. About the book Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results. What's inside Design, run, and analyze an A/B test Break the “feedback loops” caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization About the reader For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy. About the author David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University. Table of Contents 1 Optimizing systems by experiment 2 A/B testing: Evaluating a modification to your system 3 Multi-armed bandits: Maximizing business metrics while experimenting 4 Response surface methodology: Optimizing continuous parameters 5 Contextual bandits: Making targeted decisions 6 Bayesian optimization: Automating experimental optimization 7 Managing business metrics 8 Practical considerations


Bayesian Optimization in Action

Bayesian Optimization in Action

Author: Quan Nguyen

Publisher: Simon and Schuster

Published: 2023-11-14

Total Pages: 422

ISBN-13: 1633439070

DOWNLOAD EBOOK

Bayesian Optimization in Action teaches you how to build Bayesian Optimisation systems from the ground up. This book transforms state-of-the-art research into usable techniques you can easily put into practice. With a range of illustrations, and concrete examples, this book proves that Bayesian Optimisation doesn't have to be difficult!


Book Synopsis Bayesian Optimization in Action by : Quan Nguyen

Download or read book Bayesian Optimization in Action written by Quan Nguyen and published by Simon and Schuster. This book was released on 2023-11-14 with total page 422 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian Optimization in Action teaches you how to build Bayesian Optimisation systems from the ground up. This book transforms state-of-the-art research into usable techniques you can easily put into practice. With a range of illustrations, and concrete examples, this book proves that Bayesian Optimisation doesn't have to be difficult!


Bayesian Optimization

Bayesian Optimization

Author: Roman Garnett

Publisher: Cambridge University Press

Published: 2023-01-31

Total Pages: 376

ISBN-13: 1108623557

DOWNLOAD EBOOK

Bayesian optimization is a methodology for optimizing expensive objective functions that has proven success in the sciences, engineering, and beyond. This timely text provides a self-contained and comprehensive introduction to the subject, starting from scratch and carefully developing all the key ideas along the way. This bottom-up approach illuminates unifying themes in the design of Bayesian optimization algorithms and builds a solid theoretical foundation for approaching novel situations. The core of the book is divided into three main parts, covering theoretical and practical aspects of Gaussian process modeling, the Bayesian approach to sequential decision making, and the realization and computation of practical and effective optimization policies. Following this foundational material, the book provides an overview of theoretical convergence results, a survey of notable extensions, a comprehensive history of Bayesian optimization, and an extensive annotated bibliography of applications.


Book Synopsis Bayesian Optimization by : Roman Garnett

Download or read book Bayesian Optimization written by Roman Garnett and published by Cambridge University Press. This book was released on 2023-01-31 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian optimization is a methodology for optimizing expensive objective functions that has proven success in the sciences, engineering, and beyond. This timely text provides a self-contained and comprehensive introduction to the subject, starting from scratch and carefully developing all the key ideas along the way. This bottom-up approach illuminates unifying themes in the design of Bayesian optimization algorithms and builds a solid theoretical foundation for approaching novel situations. The core of the book is divided into three main parts, covering theoretical and practical aspects of Gaussian process modeling, the Bayesian approach to sequential decision making, and the realization and computation of practical and effective optimization policies. Following this foundational material, the book provides an overview of theoretical convergence results, a survey of notable extensions, a comprehensive history of Bayesian optimization, and an extensive annotated bibliography of applications.


Bayesian and High-Dimensional Global Optimization

Bayesian and High-Dimensional Global Optimization

Author: Anatoly Zhigljavsky

Publisher: Springer Nature

Published: 2021-03-02

Total Pages: 125

ISBN-13: 3030647129

DOWNLOAD EBOOK

Accessible to a variety of readers, this book is of interest to specialists, graduate students and researchers in mathematics, optimization, computer science, operations research, management science, engineering and other applied areas interested in solving optimization problems. Basic principles, potential and boundaries of applicability of stochastic global optimization techniques are examined in this book. A variety of issues that face specialists in global optimization are explored, such as multidimensional spaces which are frequently ignored by researchers. The importance of precise interpretation of the mathematical results in assessments of optimization methods is demonstrated through examples of convergence in probability of random search. Methodological issues concerning construction and applicability of stochastic global optimization methods are discussed, including the one-step optimal average improvement method based on a statistical model of the objective function. A significant portion of this book is devoted to an analysis of high-dimensional global optimization problems and the so-called ‘curse of dimensionality’. An examination of the three different classes of high-dimensional optimization problems, the geometry of high-dimensional balls and cubes, very slow convergence of global random search algorithms in large-dimensional problems , and poor uniformity of the uniformly distributed sequences of points are included in this book.


Book Synopsis Bayesian and High-Dimensional Global Optimization by : Anatoly Zhigljavsky

Download or read book Bayesian and High-Dimensional Global Optimization written by Anatoly Zhigljavsky and published by Springer Nature. This book was released on 2021-03-02 with total page 125 pages. Available in PDF, EPUB and Kindle. Book excerpt: Accessible to a variety of readers, this book is of interest to specialists, graduate students and researchers in mathematics, optimization, computer science, operations research, management science, engineering and other applied areas interested in solving optimization problems. Basic principles, potential and boundaries of applicability of stochastic global optimization techniques are examined in this book. A variety of issues that face specialists in global optimization are explored, such as multidimensional spaces which are frequently ignored by researchers. The importance of precise interpretation of the mathematical results in assessments of optimization methods is demonstrated through examples of convergence in probability of random search. Methodological issues concerning construction and applicability of stochastic global optimization methods are discussed, including the one-step optimal average improvement method based on a statistical model of the objective function. A significant portion of this book is devoted to an analysis of high-dimensional global optimization problems and the so-called ‘curse of dimensionality’. An examination of the three different classes of high-dimensional optimization problems, the geometry of high-dimensional balls and cubes, very slow convergence of global random search algorithms in large-dimensional problems , and poor uniformity of the uniformly distributed sequences of points are included in this book.


Bayesian Optimization in Action

Bayesian Optimization in Action

Author: Quan Nguyen

Publisher: Simon and Schuster

Published: 2024-01-09

Total Pages: 422

ISBN-13: 1638353875

DOWNLOAD EBOOK

Bayesian optimization helps pinpoint the best configuration for your machine learning models with speed and accuracy. Put its advanced techniques into practice with this hands-on guide. In Bayesian Optimization in Action you will learn how to: Train Gaussian processes on both sparse and large data sets Combine Gaussian processes with deep neural networks to make them flexible and expressive Find the most successful strategies for hyperparameter tuning Navigate a search space and identify high-performing regions Apply Bayesian optimization to cost-constrained, multi-objective, and preference optimization Implement Bayesian optimization with PyTorch, GPyTorch, and BoTorch Bayesian Optimization in Action shows you how to optimize hyperparameter tuning, A/B testing, and other aspects of the machine learning process by applying cutting-edge Bayesian techniques. Using clear language, illustrations, and concrete examples, this book proves that Bayesian optimization doesn’t have to be difficult! You’ll get in-depth insights into how Bayesian optimization works and learn how to implement it with cutting-edge Python libraries. The book’s easy-to-reuse code samples let you hit the ground running by plugging them straight into your own projects. Forewords by Luis Serrano and David Sweet. About the technology In machine learning, optimization is about achieving the best predictions—shortest delivery routes, perfect price points, most accurate recommendations—in the fewest number of steps. Bayesian optimization uses the mathematics of probability to fine-tune ML functions, algorithms, and hyperparameters efficiently when traditional methods are too slow or expensive. About the book Bayesian Optimization in Action teaches you how to create efficient machine learning processes using a Bayesian approach. In it, you’ll explore practical techniques for training large datasets, hyperparameter tuning, and navigating complex search spaces. This interesting book includes engaging illustrations and fun examples like perfecting coffee sweetness, predicting weather, and even debunking psychic claims. You’ll learn how to navigate multi-objective scenarios, account for decision costs, and tackle pairwise comparisons. What's inside Gaussian processes for sparse and large datasets Strategies for hyperparameter tuning Identify high-performing regions Examples in PyTorch, GPyTorch, and BoTorch About the reader For machine learning practitioners who are confident in math and statistics. About the author Quan Nguyen is a research assistant at Washington University in St. Louis. He writes for the Python Software Foundation and has authored several books on Python programming. Table of Contents 1 Introduction to Bayesian optimization 2 Gaussian processes as distributions over functions 3 Customizing a Gaussian process with the mean and covariance functions 4 Refining the best result with improvement-based policies 5 Exploring the search space with bandit-style policies 6 Leveraging information theory with entropy-based policies 7 Maximizing throughput with batch optimization 8 Satisfying extra constraints with constrained optimization 9 Balancing utility and cost with multifidelity optimization 10 Learning from pairwise comparisons with preference optimization 11 Optimizing multiple objectives at the same time 12 Scaling Gaussian processes to large datasets 13 Combining Gaussian processes with neural networks


Book Synopsis Bayesian Optimization in Action by : Quan Nguyen

Download or read book Bayesian Optimization in Action written by Quan Nguyen and published by Simon and Schuster. This book was released on 2024-01-09 with total page 422 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian optimization helps pinpoint the best configuration for your machine learning models with speed and accuracy. Put its advanced techniques into practice with this hands-on guide. In Bayesian Optimization in Action you will learn how to: Train Gaussian processes on both sparse and large data sets Combine Gaussian processes with deep neural networks to make them flexible and expressive Find the most successful strategies for hyperparameter tuning Navigate a search space and identify high-performing regions Apply Bayesian optimization to cost-constrained, multi-objective, and preference optimization Implement Bayesian optimization with PyTorch, GPyTorch, and BoTorch Bayesian Optimization in Action shows you how to optimize hyperparameter tuning, A/B testing, and other aspects of the machine learning process by applying cutting-edge Bayesian techniques. Using clear language, illustrations, and concrete examples, this book proves that Bayesian optimization doesn’t have to be difficult! You’ll get in-depth insights into how Bayesian optimization works and learn how to implement it with cutting-edge Python libraries. The book’s easy-to-reuse code samples let you hit the ground running by plugging them straight into your own projects. Forewords by Luis Serrano and David Sweet. About the technology In machine learning, optimization is about achieving the best predictions—shortest delivery routes, perfect price points, most accurate recommendations—in the fewest number of steps. Bayesian optimization uses the mathematics of probability to fine-tune ML functions, algorithms, and hyperparameters efficiently when traditional methods are too slow or expensive. About the book Bayesian Optimization in Action teaches you how to create efficient machine learning processes using a Bayesian approach. In it, you’ll explore practical techniques for training large datasets, hyperparameter tuning, and navigating complex search spaces. This interesting book includes engaging illustrations and fun examples like perfecting coffee sweetness, predicting weather, and even debunking psychic claims. You’ll learn how to navigate multi-objective scenarios, account for decision costs, and tackle pairwise comparisons. What's inside Gaussian processes for sparse and large datasets Strategies for hyperparameter tuning Identify high-performing regions Examples in PyTorch, GPyTorch, and BoTorch About the reader For machine learning practitioners who are confident in math and statistics. About the author Quan Nguyen is a research assistant at Washington University in St. Louis. He writes for the Python Software Foundation and has authored several books on Python programming. Table of Contents 1 Introduction to Bayesian optimization 2 Gaussian processes as distributions over functions 3 Customizing a Gaussian process with the mean and covariance functions 4 Refining the best result with improvement-based policies 5 Exploring the search space with bandit-style policies 6 Leveraging information theory with entropy-based policies 7 Maximizing throughput with batch optimization 8 Satisfying extra constraints with constrained optimization 9 Balancing utility and cost with multifidelity optimization 10 Learning from pairwise comparisons with preference optimization 11 Optimizing multiple objectives at the same time 12 Scaling Gaussian processes to large datasets 13 Combining Gaussian processes with neural networks