Do Gaussian processes really need Bayes?

Introduction I was first introduced to Gaussian Processes (GPs) as the quintessential example of Bayesian reasoning in machine learning. This perspective is cemented by the seminal textbook on the subject, which states in its foreword: &ldquo;Gaussian Processes for Machine Learning presents one of the most important Bayesian machine learning approaches.&rdquo; 1 And yet, the formal definition of a…