Monthly Archives: May 2013

Kernels

Posted on May 27, 2013 by Jesse Johnson

Over the last few weeks, I’ve introduced two classification methods – Support Vector Machines (SVM) and Logistic Regression – that attempt to find a line, plane or hyperplane (depending on the dimension) that separates two classes of data points. This has … Continue reading →

Posted in Classification, Normalization/Kernels | 18 Comments

Logistic regression

Posted on May 17, 2013 by Jesse Johnson

In the last post, I introduced the Support Vector Machine (SVM) algorithm, which attempts to find a line/plane/hyperplane that separates the two classes of points in a given data set. This algorithm adapts elements of linear regression, a statistical tool (namely, … Continue reading →

Posted in Classification, Regression | 18 Comments

Linear Separation and Support Vector Machines

Posted on May 14, 2013 by Jesse Johnson

So far on this blog, we’ve seen two very different approaches to constructing models that predict data distributions. With regression, we replaced the original data points with an equation defining a relatively simple shape that approximates the data, then used … Continue reading →

Posted in Classification | 18 Comments

K-Nearest Neighbors

Posted on May 7, 2013 by Jesse Johnson

Two posts back, I introduced the Nearest Neighbor classification algorithm and described how it implicitly defines a distribution made up of Voronoi cells around the data points, with each Voronoi cell labeled according to the label of the point that … Continue reading →

Posted in Classification | 8 Comments