Article jalammar.github.io

The Illustrated Transformer

Why I kept it

A reference on how transformers work.

François Paupier

jalammar.github.io27 June 2018Public source

Read the article
The Transformer takes the input Je suis étudiant and outputs I am a student.
View full preview Diagram from the post · Jay Alammar. View in context ↗
  • Transformers
  • Attention

In this reference

Jay Alammar’s illustrated introduction to the Transformer architecture.

From the post

In this post, we will attempt to oversimplify things a bit and introduce the concepts one by one to hopefully make it easier to understand to people without in-depth knowledge of the subject matter.

Jay Alammar

Cite the original work

Jay Alammar (27 June 2018). The Illustrated Transformer. jalammar.github.io. https://jalammar.github.io/illustrated-transformer/

View BibTeX
@misc{the_illustrated_transformer,
  author = {Jay Alammar},
  title = {{The Illustrated Transformer}},
  howpublished = {jalammar.github.io},
  url = {https://jalammar.github.io/illustrated-transformer/},
  year = {2018}
}
← Back to the library