Search titles and text

Keyboard shortcuts

/ or ⌘/Ctrl K: Find a note
j / k: Next / previous section or linked note
h / l: Collapse or go to parent / expand or enter
e or Alt-click: Read a linked note here
o: Open focused note on its own
g g / G: First / last section or linked note
g h / g a: Home / all notes
g b / g t: Backlinks / table of contents
t: Cycle System, Light, Dark
? / Esc: Show / close this reference

Enable single-key shortcuts

Search: ↑/↓ or Ctrl N/P, Enter to open. Shortcuts pause while typing.

adam optimizer [25b78822]

Tags: ml

www.fast.ai/2018/07/02/adam-weight-decay/
Notably keeps track of momentum, the pace at which we're doing gradient descent, and RMSP, which tried to improve adagrad.