Applied Bayesian Statistics

Applied Bayesian Statistics

Author: Mary Kathryn Cowles

Publisher: Springer Science & Business Media

Published: 2013-01-04

Total Pages: 238

ISBN-13: 1461456967

DOWNLOAD EBOOK

This book is based on over a dozen years teaching a Bayesian Statistics course. The material presented here has been used by students of different levels and disciplines, including advanced undergraduates studying Mathematics and Statistics and students in graduate programs in Statistics, Biostatistics, Engineering, Economics, Marketing, Pharmacy, and Psychology. The goal of the book is to impart the basics of designing and carrying out Bayesian analyses, and interpreting and communicating the results. In addition, readers will learn to use the predominant software for Bayesian model-fitting, R and OpenBUGS. The practical approach this book takes will help students of all levels to build understanding of the concepts and procedures required to answer real questions by performing Bayesian analysis of real data. Topics covered include comparing and contrasting Bayesian and classical methods, specifying hierarchical models, and assessing Markov chain Monte Carlo output. Kate Cowles taught Suzuki piano for many years before going to graduate school in Biostatistics. Her research areas are Bayesian and computational statistics, with application to environmental science. She is on the faculty of Statistics at The University of Iowa.


Book Synopsis Applied Bayesian Statistics by : Mary Kathryn Cowles

Download or read book Applied Bayesian Statistics written by Mary Kathryn Cowles and published by Springer Science & Business Media. This book was released on 2013-01-04 with total page 238 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book is based on over a dozen years teaching a Bayesian Statistics course. The material presented here has been used by students of different levels and disciplines, including advanced undergraduates studying Mathematics and Statistics and students in graduate programs in Statistics, Biostatistics, Engineering, Economics, Marketing, Pharmacy, and Psychology. The goal of the book is to impart the basics of designing and carrying out Bayesian analyses, and interpreting and communicating the results. In addition, readers will learn to use the predominant software for Bayesian model-fitting, R and OpenBUGS. The practical approach this book takes will help students of all levels to build understanding of the concepts and procedures required to answer real questions by performing Bayesian analysis of real data. Topics covered include comparing and contrasting Bayesian and classical methods, specifying hierarchical models, and assessing Markov chain Monte Carlo output. Kate Cowles taught Suzuki piano for many years before going to graduate school in Biostatistics. Her research areas are Bayesian and computational statistics, with application to environmental science. She is on the faculty of Statistics at The University of Iowa.


Introduction to Applied Bayesian Statistics and Estimation for Social Scientists

Introduction to Applied Bayesian Statistics and Estimation for Social Scientists

Author: Scott M. Lynch

Publisher: Springer Science & Business Media

Published: 2007-06-30

Total Pages: 376

ISBN-13: 0387712658

DOWNLOAD EBOOK

This book outlines Bayesian statistical analysis in great detail, from the development of a model through the process of making statistical inference. The key feature of this book is that it covers models that are most commonly used in social science research - including the linear regression model, generalized linear models, hierarchical models, and multivariate regression models - and it thoroughly develops each real-data example in painstaking detail.


Book Synopsis Introduction to Applied Bayesian Statistics and Estimation for Social Scientists by : Scott M. Lynch

Download or read book Introduction to Applied Bayesian Statistics and Estimation for Social Scientists written by Scott M. Lynch and published by Springer Science & Business Media. This book was released on 2007-06-30 with total page 376 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book outlines Bayesian statistical analysis in great detail, from the development of a model through the process of making statistical inference. The key feature of this book is that it covers models that are most commonly used in social science research - including the linear regression model, generalized linear models, hierarchical models, and multivariate regression models - and it thoroughly develops each real-data example in painstaking detail.


The Oxford Handbook of Applied Bayesian Analysis

The Oxford Handbook of Applied Bayesian Analysis

Author: Anthony O' Hagan

Publisher: OUP Oxford

Published: 2010-03-18

Total Pages: 928

ISBN-13: 0191582824

DOWNLOAD EBOOK

Bayesian analysis has developed rapidly in applications in the last two decades and research in Bayesian methods remains dynamic and fast-growing. Dramatic advances in modelling concepts and computational technologies now enable routine application of Bayesian analysis using increasingly realistic stochastic models, and this drives the adoption of Bayesian approaches in many areas of science, technology, commerce, and industry. This Handbook explores contemporary Bayesian analysis across a variety of application areas. Chapters written by leading exponents of applied Bayesian analysis showcase the scientific ease and natural application of Bayesian modelling, and present solutions to real, engaging, societally important and demanding problems. The chapters are grouped into five general areas: Biomedical & Health Sciences; Industry, Economics & Finance; Environment & Ecology; Policy, Political & Social Sciences; and Natural & Engineering Sciences, and Appendix material in each touches on key concepts, models, and techniques of the chapter that are also of broader pedagogic and applied interest.


Book Synopsis The Oxford Handbook of Applied Bayesian Analysis by : Anthony O' Hagan

Download or read book The Oxford Handbook of Applied Bayesian Analysis written by Anthony O' Hagan and published by OUP Oxford. This book was released on 2010-03-18 with total page 928 pages. Available in PDF, EPUB and Kindle. Book excerpt: Bayesian analysis has developed rapidly in applications in the last two decades and research in Bayesian methods remains dynamic and fast-growing. Dramatic advances in modelling concepts and computational technologies now enable routine application of Bayesian analysis using increasingly realistic stochastic models, and this drives the adoption of Bayesian approaches in many areas of science, technology, commerce, and industry. This Handbook explores contemporary Bayesian analysis across a variety of application areas. Chapters written by leading exponents of applied Bayesian analysis showcase the scientific ease and natural application of Bayesian modelling, and present solutions to real, engaging, societally important and demanding problems. The chapters are grouped into five general areas: Biomedical & Health Sciences; Industry, Economics & Finance; Environment & Ecology; Policy, Political & Social Sciences; and Natural & Engineering Sciences, and Appendix material in each touches on key concepts, models, and techniques of the chapter that are also of broader pedagogic and applied interest.


Bayes Rules!

Bayes Rules!

Author: Alicia A. Johnson

Publisher: CRC Press

Published: 2022-03-03

Total Pages: 606

ISBN-13: 1000529568

DOWNLOAD EBOOK

Praise for Bayes Rules!: An Introduction to Applied Bayesian Modeling “A thoughtful and entertaining book, and a great way to get started with Bayesian analysis.” Andrew Gelman, Columbia University “The examples are modern, and even many frequentist intro books ignore important topics (like the great p-value debate) that the authors address. The focus on simulation for understanding is excellent.” Amy Herring, Duke University “I sincerely believe that a generation of students will cite this book as inspiration for their use of – and love for – Bayesian statistics. The narrative holds the reader’s attention and flows naturally – almost conversationally. Put simply, this is perhaps the most engaging introductory statistics textbook I have ever read. [It] is a natural choice for an introductory undergraduate course in applied Bayesian statistics." Yue Jiang, Duke University “This is by far the best book I’ve seen on how to (and how to teach students to) do Bayesian modeling and understand the underlying mathematics and computation. The authors build intuition and scaffold ideas expertly, using interesting real case studies, insightful graphics, and clear explanations. The scope of this book is vast – from basic building blocks to hierarchical modeling, but the authors’ thoughtful organization allows the reader to navigate this journey smoothly. And impressively, by the end of the book, one can run sophisticated Bayesian models and actually understand the whys, whats, and hows.” Paul Roback, St. Olaf College “The authors provide a compelling, integrated, accessible, and non-religious introduction to statistical modeling using a Bayesian approach. They outline a principled approach that features computational implementations and model assessment with ethical implications interwoven throughout. Students and instructors will find the conceptual and computational exercises to be fresh and engaging.” Nicholas Horton, Amherst College An engaging, sophisticated, and fun introduction to the field of Bayesian statistics, Bayes Rules!: An Introduction to Applied Bayesian Modeling brings the power of modern Bayesian thinking, modeling, and computing to a broad audience. In particular, the book is an ideal resource for advanced undergraduate statistics students and practitioners with comparable experience. Bayes Rules! empowers readers to weave Bayesian approaches into their everyday practice. Discussions and applications are data driven. A natural progression from fundamental to multivariable, hierarchical models emphasizes a practical and generalizable model building process. The evaluation of these Bayesian models reflects the fact that a data analysis does not exist in a vacuum. Features • Utilizes data-driven examples and exercises. • Emphasizes the iterative model building and evaluation process. • Surveys an interconnected range of multivariable regression and classification models. • Presents fundamental Markov chain Monte Carlo simulation. • Integrates R code, including RStan modeling tools and the bayesrules package. • Encourages readers to tap into their intuition and learn by doing. • Provides a friendly and inclusive introduction to technical Bayesian concepts. • Supports Bayesian applications with foundational Bayesian theory.


Book Synopsis Bayes Rules! by : Alicia A. Johnson

Download or read book Bayes Rules! written by Alicia A. Johnson and published by CRC Press. This book was released on 2022-03-03 with total page 606 pages. Available in PDF, EPUB and Kindle. Book excerpt: Praise for Bayes Rules!: An Introduction to Applied Bayesian Modeling “A thoughtful and entertaining book, and a great way to get started with Bayesian analysis.” Andrew Gelman, Columbia University “The examples are modern, and even many frequentist intro books ignore important topics (like the great p-value debate) that the authors address. The focus on simulation for understanding is excellent.” Amy Herring, Duke University “I sincerely believe that a generation of students will cite this book as inspiration for their use of – and love for – Bayesian statistics. The narrative holds the reader’s attention and flows naturally – almost conversationally. Put simply, this is perhaps the most engaging introductory statistics textbook I have ever read. [It] is a natural choice for an introductory undergraduate course in applied Bayesian statistics." Yue Jiang, Duke University “This is by far the best book I’ve seen on how to (and how to teach students to) do Bayesian modeling and understand the underlying mathematics and computation. The authors build intuition and scaffold ideas expertly, using interesting real case studies, insightful graphics, and clear explanations. The scope of this book is vast – from basic building blocks to hierarchical modeling, but the authors’ thoughtful organization allows the reader to navigate this journey smoothly. And impressively, by the end of the book, one can run sophisticated Bayesian models and actually understand the whys, whats, and hows.” Paul Roback, St. Olaf College “The authors provide a compelling, integrated, accessible, and non-religious introduction to statistical modeling using a Bayesian approach. They outline a principled approach that features computational implementations and model assessment with ethical implications interwoven throughout. Students and instructors will find the conceptual and computational exercises to be fresh and engaging.” Nicholas Horton, Amherst College An engaging, sophisticated, and fun introduction to the field of Bayesian statistics, Bayes Rules!: An Introduction to Applied Bayesian Modeling brings the power of modern Bayesian thinking, modeling, and computing to a broad audience. In particular, the book is an ideal resource for advanced undergraduate statistics students and practitioners with comparable experience. Bayes Rules! empowers readers to weave Bayesian approaches into their everyday practice. Discussions and applications are data driven. A natural progression from fundamental to multivariable, hierarchical models emphasizes a practical and generalizable model building process. The evaluation of these Bayesian models reflects the fact that a data analysis does not exist in a vacuum. Features • Utilizes data-driven examples and exercises. • Emphasizes the iterative model building and evaluation process. • Surveys an interconnected range of multivariable regression and classification models. • Presents fundamental Markov chain Monte Carlo simulation. • Integrates R code, including RStan modeling tools and the bayesrules package. • Encourages readers to tap into their intuition and learn by doing. • Provides a friendly and inclusive introduction to technical Bayesian concepts. • Supports Bayesian applications with foundational Bayesian theory.


Bayesian Data Analysis, Third Edition

Bayesian Data Analysis, Third Edition

Author: Andrew Gelman

Publisher: CRC Press

Published: 2013-11-01

Total Pages: 677

ISBN-13: 1439840954

DOWNLOAD EBOOK

Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.


Book Synopsis Bayesian Data Analysis, Third Edition by : Andrew Gelman

Download or read book Bayesian Data Analysis, Third Edition written by Andrew Gelman and published by CRC Press. This book was released on 2013-11-01 with total page 677 pages. Available in PDF, EPUB and Kindle. Book excerpt: Now in its third edition, this classic book is widely considered the leading text on Bayesian methods, lauded for its accessible, practical approach to analyzing data and solving research problems. Bayesian Data Analysis, Third Edition continues to take an applied approach to analysis using up-to-date Bayesian methods. The authors—all leaders in the statistics community—introduce basic concepts from a data-analytic perspective before presenting advanced methods. Throughout the text, numerous worked examples drawn from real applications and research emphasize the use of Bayesian inference in practice. New to the Third Edition Four new chapters on nonparametric modeling Coverage of weakly informative priors and boundary-avoiding priors Updated discussion of cross-validation and predictive information criteria Improved convergence monitoring and effective sample size calculations for iterative simulation Presentations of Hamiltonian Monte Carlo, variational Bayes, and expectation propagation New and revised software code The book can be used in three different ways. For undergraduate students, it introduces Bayesian inference starting from first principles. For graduate students, the text presents effective current approaches to Bayesian modeling and computation in statistics and related fields. For researchers, it provides an assortment of Bayesian methods in applied statistics. Additional materials, including data sets used in the examples, solutions to selected exercises, and software instructions, are available on the book’s web page.


Applied Bayesian and Classical Inference

Applied Bayesian and Classical Inference

Author: F. Mosteller

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 341

ISBN-13: 1461252563

DOWNLOAD EBOOK

The new version has two additions. First, at the suggestion of Stephen Stigler I we have replaced the Table of Contents by what he calls an Analytic Table of Contents. Following the title of each section or subsection is a description of the content of the section. This material helps the reader in several ways, for example: by giving a synopsis of the book, by explaining where the various data tables are and what they deal with, by telling what theory is described where. We did several distinct full studies for the Federalist papers as well as many minor side studies. Some or all may offer information both to the applied and the theoretical reader. We therefore try to give in this Contents more than the few cryptic words in a section heading to ~peed readers in finding what they want. Seconq, we have prepared an extra chapter dealing with authorship work published from. about 1969 to 1983. Although a chapter cannot compre hensively Gover a field where many books now appear, it can mention most ofthe book-length works and the main thread of authorship' studies published in English. We founq biblical authorship studies so extensive and com plicated that we thought it worthwhile to indicate some papers that would bring out the controversies that are taking place. We hope we have given the flavor of developments over the 15 years mentioned. We have also corrected a few typographical errors.


Book Synopsis Applied Bayesian and Classical Inference by : F. Mosteller

Download or read book Applied Bayesian and Classical Inference written by F. Mosteller and published by Springer Science & Business Media. This book was released on 2012-12-06 with total page 341 pages. Available in PDF, EPUB and Kindle. Book excerpt: The new version has two additions. First, at the suggestion of Stephen Stigler I we have replaced the Table of Contents by what he calls an Analytic Table of Contents. Following the title of each section or subsection is a description of the content of the section. This material helps the reader in several ways, for example: by giving a synopsis of the book, by explaining where the various data tables are and what they deal with, by telling what theory is described where. We did several distinct full studies for the Federalist papers as well as many minor side studies. Some or all may offer information both to the applied and the theoretical reader. We therefore try to give in this Contents more than the few cryptic words in a section heading to ~peed readers in finding what they want. Seconq, we have prepared an extra chapter dealing with authorship work published from. about 1969 to 1983. Although a chapter cannot compre hensively Gover a field where many books now appear, it can mention most ofthe book-length works and the main thread of authorship' studies published in English. We founq biblical authorship studies so extensive and com plicated that we thought it worthwhile to indicate some papers that would bring out the controversies that are taking place. We hope we have given the flavor of developments over the 15 years mentioned. We have also corrected a few typographical errors.


Applied Bayesian Modeling and Causal Inference from Incomplete-Data Perspectives

Applied Bayesian Modeling and Causal Inference from Incomplete-Data Perspectives

Author: Andrew Gelman

Publisher: John Wiley & Sons

Published: 2004-09-03

Total Pages: 448

ISBN-13: 9780470090435

DOWNLOAD EBOOK

This book brings together a collection of articles on statistical methods relating to missing data analysis, including multiple imputation, propensity scores, instrumental variables, and Bayesian inference. Covering new research topics and real-world examples which do not feature in many standard texts. The book is dedicated to Professor Don Rubin (Harvard). Don Rubin has made fundamental contributions to the study of missing data. Key features of the book include: Comprehensive coverage of an imporant area for both research and applications. Adopts a pragmatic approach to describing a wide range of intermediate and advanced statistical techniques. Covers key topics such as multiple imputation, propensity scores, instrumental variables and Bayesian inference. Includes a number of applications from the social and health sciences. Edited and authored by highly respected researchers in the area.


Book Synopsis Applied Bayesian Modeling and Causal Inference from Incomplete-Data Perspectives by : Andrew Gelman

Download or read book Applied Bayesian Modeling and Causal Inference from Incomplete-Data Perspectives written by Andrew Gelman and published by John Wiley & Sons. This book was released on 2004-09-03 with total page 448 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book brings together a collection of articles on statistical methods relating to missing data analysis, including multiple imputation, propensity scores, instrumental variables, and Bayesian inference. Covering new research topics and real-world examples which do not feature in many standard texts. The book is dedicated to Professor Don Rubin (Harvard). Don Rubin has made fundamental contributions to the study of missing data. Key features of the book include: Comprehensive coverage of an imporant area for both research and applications. Adopts a pragmatic approach to describing a wide range of intermediate and advanced statistical techniques. Covers key topics such as multiple imputation, propensity scores, instrumental variables and Bayesian inference. Includes a number of applications from the social and health sciences. Edited and authored by highly respected researchers in the area.


A Student’s Guide to Bayesian Statistics

A Student’s Guide to Bayesian Statistics

Author: Ben Lambert

Publisher: SAGE

Published: 2018-04-20

Total Pages: 744

ISBN-13: 1526418266

DOWNLOAD EBOOK

Supported by a wealth of learning features, exercises, and visual elements as well as online video tutorials and interactive simulations, this book is the first student-focused introduction to Bayesian statistics. Without sacrificing technical integrity for the sake of simplicity, the author draws upon accessible, student-friendly language to provide approachable instruction perfectly aimed at statistics and Bayesian newcomers. Through a logical structure that introduces and builds upon key concepts in a gradual way and slowly acclimatizes students to using R and Stan software, the book covers: An introduction to probability and Bayesian inference Understanding Bayes′ rule Nuts and bolts of Bayesian analytic methods Computational Bayes and real-world Bayesian analysis Regression analysis and hierarchical methods This unique guide will help students develop the statistical confidence and skills to put the Bayesian formula into practice, from the basic concepts of statistical inference to complex applications of analyses.


Book Synopsis A Student’s Guide to Bayesian Statistics by : Ben Lambert

Download or read book A Student’s Guide to Bayesian Statistics written by Ben Lambert and published by SAGE. This book was released on 2018-04-20 with total page 744 pages. Available in PDF, EPUB and Kindle. Book excerpt: Supported by a wealth of learning features, exercises, and visual elements as well as online video tutorials and interactive simulations, this book is the first student-focused introduction to Bayesian statistics. Without sacrificing technical integrity for the sake of simplicity, the author draws upon accessible, student-friendly language to provide approachable instruction perfectly aimed at statistics and Bayesian newcomers. Through a logical structure that introduces and builds upon key concepts in a gradual way and slowly acclimatizes students to using R and Stan software, the book covers: An introduction to probability and Bayesian inference Understanding Bayes′ rule Nuts and bolts of Bayesian analytic methods Computational Bayes and real-world Bayesian analysis Regression analysis and hierarchical methods This unique guide will help students develop the statistical confidence and skills to put the Bayesian formula into practice, from the basic concepts of statistical inference to complex applications of analyses.


Case Studies in Applied Bayesian Data Science

Case Studies in Applied Bayesian Data Science

Author: Kerrie L. Mengersen

Publisher: Springer Nature

Published: 2020-05-28

Total Pages: 415

ISBN-13: 3030425533

DOWNLOAD EBOOK

Presenting a range of substantive applied problems within Bayesian Statistics along with their Bayesian solutions, this book arises from a research program at CIRM in France in the second semester of 2018, which supported Kerrie Mengersen as a visiting Jean-Morlet Chair and Pierre Pudlo as the local Research Professor. The field of Bayesian statistics has exploded over the past thirty years and is now an established field of research in mathematical statistics and computer science, a key component of data science, and an underpinning methodology in many domains of science, business and social science. Moreover, while remaining naturally entwined, the three arms of Bayesian statistics, namely modelling, computation and inference, have grown into independent research fields. While the research arms of Bayesian statistics continue to grow in many directions, they are harnessed when attention turns to solving substantive applied problems. Each such problem set has its own challenges and hence draws from the suite of research a bespoke solution. The book will be useful for both theoretical and applied statisticians, as well as practitioners, to inspect these solutions in the context of the problems, in order to draw further understanding, awareness and inspiration.


Book Synopsis Case Studies in Applied Bayesian Data Science by : Kerrie L. Mengersen

Download or read book Case Studies in Applied Bayesian Data Science written by Kerrie L. Mengersen and published by Springer Nature. This book was released on 2020-05-28 with total page 415 pages. Available in PDF, EPUB and Kindle. Book excerpt: Presenting a range of substantive applied problems within Bayesian Statistics along with their Bayesian solutions, this book arises from a research program at CIRM in France in the second semester of 2018, which supported Kerrie Mengersen as a visiting Jean-Morlet Chair and Pierre Pudlo as the local Research Professor. The field of Bayesian statistics has exploded over the past thirty years and is now an established field of research in mathematical statistics and computer science, a key component of data science, and an underpinning methodology in many domains of science, business and social science. Moreover, while remaining naturally entwined, the three arms of Bayesian statistics, namely modelling, computation and inference, have grown into independent research fields. While the research arms of Bayesian statistics continue to grow in many directions, they are harnessed when attention turns to solving substantive applied problems. Each such problem set has its own challenges and hence draws from the suite of research a bespoke solution. The book will be useful for both theoretical and applied statisticians, as well as practitioners, to inspect these solutions in the context of the problems, in order to draw further understanding, awareness and inspiration.


Mathematical Theory of Bayesian Statistics

Mathematical Theory of Bayesian Statistics

Author: Sumio Watanabe

Publisher: CRC Press

Published: 2018-04-27

Total Pages: 331

ISBN-13: 148223808X

DOWNLOAD EBOOK

Mathematical Theory of Bayesian Statistics introduces the mathematical foundation of Bayesian inference which is well-known to be more accurate in many real-world problems than the maximum likelihood method. Recent research has uncovered several mathematical laws in Bayesian statistics, by which both the generalization loss and the marginal likelihood are estimated even if the posterior distribution cannot be approximated by any normal distribution. Features Explains Bayesian inference not subjectively but objectively. Provides a mathematical framework for conventional Bayesian theorems. Introduces and proves new theorems. Cross validation and information criteria of Bayesian statistics are studied from the mathematical point of view. Illustrates applications to several statistical problems, for example, model selection, hyperparameter optimization, and hypothesis tests. This book provides basic introductions for students, researchers, and users of Bayesian statistics, as well as applied mathematicians. Author Sumio Watanabe is a professor of Department of Mathematical and Computing Science at Tokyo Institute of Technology. He studies the relationship between algebraic geometry and mathematical statistics.


Book Synopsis Mathematical Theory of Bayesian Statistics by : Sumio Watanabe

Download or read book Mathematical Theory of Bayesian Statistics written by Sumio Watanabe and published by CRC Press. This book was released on 2018-04-27 with total page 331 pages. Available in PDF, EPUB and Kindle. Book excerpt: Mathematical Theory of Bayesian Statistics introduces the mathematical foundation of Bayesian inference which is well-known to be more accurate in many real-world problems than the maximum likelihood method. Recent research has uncovered several mathematical laws in Bayesian statistics, by which both the generalization loss and the marginal likelihood are estimated even if the posterior distribution cannot be approximated by any normal distribution. Features Explains Bayesian inference not subjectively but objectively. Provides a mathematical framework for conventional Bayesian theorems. Introduces and proves new theorems. Cross validation and information criteria of Bayesian statistics are studied from the mathematical point of view. Illustrates applications to several statistical problems, for example, model selection, hyperparameter optimization, and hypothesis tests. This book provides basic introductions for students, researchers, and users of Bayesian statistics, as well as applied mathematicians. Author Sumio Watanabe is a professor of Department of Mathematical and Computing Science at Tokyo Institute of Technology. He studies the relationship between algebraic geometry and mathematical statistics.