In the age of big data, making sense of high-dimensional datasets is a common challenge. Principal Component Analysis (PCA) is one of the most powerful tools in the data scientist’s toolkit for reducing dimensionality while preserving the essence of the data. By identifying directions—called principal components—along which the data varies the most, PCA allows us to simplify complex datasets, v...
“What I cannot create, I do not understand” — Richard Feynman. This post is long overdue, but better late than never! As I graduate high school and move on to college, I wanted to take a moment to wrap up this chapter of my ML journey. (For first-time visitors: I founded a Machine Learning Club at my high school, where I taught weekly lectures to over 60 students. This blog became the ho...
Linear Regression is all about lines of best fit for a given dataset. But how do we find lines of best fit? Here is a quick answer: Start with a random line For each data point in dataset a) Find how “close” the line is to the point b) Depending on how close/far the line is, move the line a step towards the point Step 2 can be repeated multiple times (called epochs) I...
In Carnatic (and in Hindustani, though this blog post will focus on Carnatic) music, there is the concept of raga. At face value, a raga is just a scale or a collection of notes. Think of it as a subset of 16 possible notes: [R \subset {S, R1, R2, R3, G1, G2, G3, M1, M2, P, D1, D2, D3, N1, N2, N3}.] Each of these notes has a name, e.g. $S$ is Shadjam, and the numbers appended to the end of ...
In this ML Club session, we’ll learn how to visualize 1000-dimensional data! High dimensional data is everywhere! How do we do this? We have to represent a 1000 dimensions in 2 dimensions such that the meaning of the data is still preserved. In the session we talk about two very different approaches – Principal Component Analysis and t-Distributed Stochastic Neighbor Embedding. How do these ...