What We Talk About When We Talk About Attention
The "attention" in ML is "what you should attend to," not "alertness." In the sentence "They crossed the <???> to get to the other bank." you need to "attend to" the <???> word to disambiguate "bank". If <???> is "street" then it's "bank" as in "financial institution" (most likely). If <???> is "river" then …
more ...