In this video we read the original transformer paper "Attention is all you need" and implement it from scratch!

Attention is all you need paper:
https://arxiv.org/abs/1706.03762

A good blogpost on Transformers:
http://www.peterbloem.nl/blog/transformers

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:54 - Paper Review
11:20 - Attention Mechanism
27:00 - TransformerBlock
32:18 - Encoder
38:20 - DecoderBlock
42:00 - Decoder
46:55 - Putting it togethor to form The Transformer
52:45 - A Small Example
54:25 - Fixing Errors
56:44 - Ending

Movie/album: Kites
Singers: Krishnakumar Kunnath (K.K)
Song Lyricists: Naseer Faraaz
Music Composer: Rajesh Roshan
Music Director: Rajesh Roshan
Music Label: T-Series
Starring: Hrithik Roshan, Bárbara Mori, Kangana Ranaut, Kabir Bedi, Nick Brown
Release on: 21st May, 2010

Song Lyrics 👇

Zindagi do pal ki
Zindagi do pal ki


Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala
Zindagi do pal ki


Dil mein tumhari chhupa
Di hai mene to apni yeh jaan
Abb tumhi isko sambhalo
Humein apna hosh kahan


Bekhudi do pal ki
Zindagi do pal ki
Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala


Ek chhota sa vaada is umar se
Zyada sachcha hain sanam
Har modh par saath is liye
Rahete hain ab dono


Dosti do pal ki
Zindagi do pal ki
Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala


Zindagi do pal ki
Zindagi do pal ki.