The Annotated Transformer with Commentary

A line-by-line walkthrough of the Transformer architecture from "Attention is All You Need", with added explanations and commentary.