Gradient Descent Doesn't Know Where the Minimum Is: It Only Knows Which Way Is Down
Backpropagation tells you the gradient: how much each weight should change to reduce the cost. Gradient Descent is the algorithm that actually uses that gradien
Learning ML in public. Every entry is a day of studying: what clicked, what confused me, and what I'm pulling on next. Writing forces me to actually understand things, not just watch them go by. If it helps someone else figure something out, even better.
Daily notes on machine learning, deep learning, and AI.
3 entries