-
Recurrent nets to attention: why sequence models dropped the loop
For years, the standard approach to understanding a sequence was straightforward: read one element, update an internal memory, move to the next element, and repeat.
For years, the standard approach to understanding a sequence was straightforward: read one element, update an internal memory, move to the next element, and repeat.