Machine Learning
In my last post, I discussed how Andrej Karpathy fell a little short on building intuition around the attention mechanism in his Neural Nets – Zero to Hero series. In that post I shared how I was doing my own diagrams of…
Machine Learning
I’ve been going through Andrej Karpathy’s Neural Nets: Zero to Hero playlist. I’ve spent the last few days on one of the later ones: Let’s build GPT: from scratch, in code, spelled out. As an aside, I should note that…
Machine Learning
What a difference a great teacher makes. Recently, I completed the Coursera Generative AI with Large Language Models course. As I alluded to on LinkedIn, it was a letdown. It didn’t explain the mechanics of how LLMs work. The closest…
Machine Learning
Despite my critical appraisal Udacity in my last post, I have been trying to keep an open mind and remain optimistic that the course would begin to start pulling its weight in terms of instruction. Having started the next unit,…
Machine Learning
I started the nano-degree over a year ago last year. The company I was working for at the time was in some dire straits and I had a lot going on so I dropped it back then. The company ended…
Machine Learning
I’ve taken quite a few ML/AI of courses on Coursera, and so far, Udacity is a very different experience. All of the Coursera material is covered by Andrew Ng himself in some fairly bare-bones videos with relatively low production values….
Machine Learning
Yesterday morning, for all the reasons I outlined in the last post, I was torn about whether to sign up for the Udacity Deep Reinforcement Learning Nanodegree. So I went to the main course page for enrollment, and for some…
Machine Learning
There has been a lot of drama for me in the last month and a half—both in my life and at work. I’ve been plugging away a bit at my model, but that’s mostly rearranging furniture at this point. As…
Machine Learning
It seems that the fundamental algorithm for inspecting possible moves from a given board position is minimax (or minmax). As usual, there are different ways to explain what’s going on with this. The Wikipedia page linked to above is replete…
Machine Learning
I had decided that I was going to write out in plain english how the AlphaGo Zero algorithm works. My plan is still to do that, but one big component of it is the critical Monte Carlo Tree Search algorithm….