Systolic arrays [8393a810]
Systolic arrays
- cannon's algorithm and summa in hpc
- Systolic arrays used by video encoding
-
Ht Kung originally left the field because of networking issues, systolic arrays were gated by issues of networking
- revisited in 2012 by norm juppie
- Jeff hinton
- Simplifies io
- Originally birthed in cray era, vector ALU, cheap memory, expensive compute, optimizing for word per cycle
- Only so many pins, only so many bandwidth
- Amdhal's law
- Gpgpu issues? Why it was slower?
- Tpu origin because of voice
- Interconnect and memory
- now solved with the extremely complex interconnects
- Broadcast once, flow once