Important AI information.
Neural Machine Translation by Jointly Learning to Align and Translate
This study is the most important study that started the true AI wave. Without the attention mechanism discovered here, none of this technology would be possible.
An article that explains the Attention Mechanism
Attention Is All You Need
Attention Is All You Need is one of the most important studies regarding AI and defines how most models are crafted today. This study introduced the transformer, which is an expansion of the Attention Mechanism.
What did GPT use as Pretraining Material?
