Introduction In the first post of the series we discussed in depth the implementation details of micrograd, which is basiclly a python implementation of the backpropegation algorithm. In the end of that post I tried to give a small incentive why backpropegation is such an important algorithm and today we will cotinue following Andrejs lecture series and dive a lot deeper into where it fits in the…
Introduction In this first post in a series of posts where I will deep dive into the lectures of Andrej Karpathy’s “Neural Networks: Zero to Hero” course. I want to explore the small details that were skimmed through, left out or not explained in depth in the first lecture about micrograd. And hopefully add some intuition and motivation behind some concepts that were introduced in that lecture.