Understanding backprop
- Knows gradient from testing only ONE hypothesis
- But does not know anything else about error surface
- That's the general ML problem!
- Attempt to visualize relationship between:
- Use of update factors to change weights
- Effect of this on nonlinear partition of instance space
- ...of multidimensional instance space!
- My knee hurt a LOT