Just wrote a blog about the explosion of papers titled after Attention Is All You Need [1]. Also figured out the name probably didn’t originate from one of the authors.

[1]https://open.substack.com/pub/0x7f1/p/is-all-you-need-is-all...