Note: This post is the ultimate result of my quest for how to do softmax backpropagation in my hand-coded model for this project. The actual math for softmax back propagation is not something that was specifically covered in my coursework….

…and it is not lost on me now that I may have had a problem with my gradients which I did not check… –  Me, five days ago After taking a brief hiatus from my checkers AI to do some…

A couple of days ago, I got all the machinery of my network in place and did my first test. I decided that for starters, using a network I wasn’t even sure worked for a problem I’ve never tackled before…