Remark #2: The Adam update

A short note on Adam&#x27;s update size, the coupling of beta1 and beta2, bias correction, epsilon, and how these relate to stability and warmup.