TomBolton.io

Tom Bolton’s AI and Machine Learning Lab Notebook.

Machine Learning

I’ve completed changing my code to support a model designed to win games rather than guess legal moves. The model is the same, but the reward function, some game details, and much of the administrative framework has changed. The actual…

Machine Learning

I started actually doing AI again. As I was watching all the Karpathy videos, I found myself wanting to stop watching videos and get back to building. I could have gone out and built Karpathy’s nano-gpt model, but he already…

Machine Learning

In my last post, I discussed how Andrej Karpathy fell a little short on building intuition around the attention mechanism in his Neural Nets – Zero to Hero series. In that post I shared how I was doing my own diagrams of…

Machine Learning

I’ve been going through Andrej Karpathy’s Neural Nets: Zero to Hero playlist. I’ve spent the last few days on one of the later ones: Let’s build GPT: from scratch, in code, spelled out. As an aside, I should note that…

Machine Learning

What a difference a great teacher makes. Recently, I completed the Coursera Generative AI with Large Language Models course. As I alluded to on LinkedIn, it was a letdown. It didn’t explain the mechanics of how LLMs work. The closest…

Machine Learning

Despite my critical appraisal Udacity in my last post, I have been trying to keep an open mind and remain optimistic that the course would begin to start pulling its weight in terms of instruction. Having started the next unit,…

Machine Learning

I started the nano-degree over a year ago last year. The company I was working for at the time was in some dire straits and I had a lot going on so I dropped it back then. The company ended…

Machine Learning

I’ve taken quite a few ML/AI of courses on Coursera, and so far, Udacity is a very different experience. All of the Coursera material is covered by Andrew Ng himself in some fairly bare-bones videos with relatively low production values….

Machine Learning

Yesterday morning, for all the reasons I outlined in the last post, I was torn about whether to sign up for the Udacity Deep Reinforcement Learning Nanodegree. So I went to the main course page for enrollment, and for some…

Machine Learning

There has been a lot of drama for me in the last month and a half—both in my life and at work. I’ve been plugging away a bit at my model, but that’s mostly rearranging furniture at this point. As…