Understanding Transformers: Intuition and mathematics of attention

We give a thorough introduction to the intuition and equations of self-attention and transformers. No prior experience needed. This discussion serves to get us on the same page for further discussions on large language models (hardware implementations, new algorithm design, few-shot learning, is it AGI?).

Go to group wiki Go to wiki users Info

Timetable

Moderator

Members