In this video we read the original transformer paper "Attention is all you need" and implement it from scratch!

Attention is all you need paper:
https://arxiv.org/abs/1706.03762

A good blogpost on Transformers:
http://www.peterbloem.nl/blog/transformers

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:54 - Paper Review
11:20 - Attention Mechanism
27:00 - TransformerBlock
32:18 - Encoder
38:20 - DecoderBlock
42:00 - Decoder
46:55 - Putting it togethor to form The Transformer
52:45 - A Small Example
54:25 - Fixing Errors
56:44 - Ending

Movie/album: Kites
Singers: Krishnakumar Kunnath (K.K)
Song Lyricists: Naseer Faraaz
Music Composer: Rajesh Roshan
Music Director: Rajesh Roshan
Music Label: T-Series
Starring: Hrithik Roshan, Bárbara Mori, Kangana Ranaut, Kabir Bedi, Nick Brown
Release on: 21st May, 2010

Song Lyrics 👇

Zindagi do pal ki
Zindagi do pal ki


Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala
Zindagi do pal ki


Dil mein tumhari chhupa
Di hai mene to apni yeh jaan
Abb tumhi isko sambhalo
Humein apna hosh kahan


Bekhudi do pal ki
Zindagi do pal ki
Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala


Ek chhota sa vaada is umar se
Zyada sachcha hain sanam
Har modh par saath is liye
Rahete hain ab dono


Dosti do pal ki
Zindagi do pal ki
Intezar kab tak
Hum karenge bhala
Tumhe pyaar
Kab tak na karenge bhala


Zindagi do pal ki
Zindagi do pal ki.

CHROMA GALAXIES is the total of my expertise in designing landscapes and otherworldly sceneries with paint. Following the script of creativeblack from Giantstep, I shot a total of almost 35 Terabytes in 8K Raw Video over a period of 8 months, including the complete set of inks and fluids, macro lenses, lights and motion control. All scenes were created on paper.

The visuals are accompanied by a composition from Tristan Barton. Find out more about his outstanding work here: https://www.tristanbartonmusic.com/

_________________________________________________________
+++ My Channel: https://www.youtube.com/channe....l/UCjcjr8OhwzA1cvG_1 +++
+++ My Instagram: https://www.instagram.com/romandegiuli +++
+++ My Facebook: http://www.facebook.com/terracollage +++
+++ My Website: http://www.terracollage.com +++
_________________________________________________________

CHROMA GALAXIES is available for licensing in 4K and 8K, both SDR and HDR.

Fluid Art: Roman De Giuli
Music: Tristan Barton
Concept: Giantstep // Creative Black // Soyoung Kim
Production: Terracollage
Assistant: Daniel Augustin

Many thanks to all people who have been involved in this project!

Terracollage // Experimental Fluid Art and Macro Cinematography // Licensing // Production // 8K // HDR

http://www.terracollage.com
http://www.facebook.com/terracollage
http://www.instagram.com/romandegiuli

#8k #hdr #colors

Simpletransformer library is based on the Transformers library by HuggingFace. Simple Transformers lets you quickly train and evaluate Transformer models. Only 3 lines of code are needed to initialize a model, train the model, and evaluate a model.
github: https://github.com/krishnaik06/Trnasformer-Bert
simple transformer: https://simpletransformers.ai/docs/qa-specifics/
simple transformer github: https://github.com/ThilinaRaja....pakse/simpletransfor
⭐ Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I've been using Kite for a few months and I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=krishnaik&utm_content=description-only
Subscribe my vlogging channel
https://www.youtube.com/channe....l/UCjWY5hREA6FFYrthD
Please donate if you want to support the channel through GPay UPID,
Gpay: krishnaik06@okicici
Telegram link: https://t.me/joinchat/N77M7xRvYUd403DgfE4TWw

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more
https://www.youtube.com/channe....l/UCNU_lfiiWBdtULKOw

Connect with me here:
Twitter: https://twitter.com/Krishnaik06
Facebook: https://www.facebook.com/krishnaik06
instagram: https://www.instagram.com/krishnaik06

Thoda Thoda Pyaar Full Video Song 4k 60fps - Sidharth Malhotra & Neha Sharma

Free Amazon Prime for 1 Month (India):
https://www.freedeal4u.com/

Thoda Thoda Pyaar Lyrics:

Teri Nazar Ne Yeh Kya Kar Diya
Mujhse Hi Mujhko Juda Kar Diya

Teri Nazar Ne Yeh Kya Kar Diya
Mujhse Hi Mujhko Juda Kar Diya
Main Rehta Hoon Tere Paas Kahin
Ab Mujhko Mera Ehsaas Nahi
Dil Kehta Hai Bas Mujhe

Ke Thoda Thoda Pyaar Hua Tumse
Ke Thoda Ikraar Hua Tumse
Ke Thoda Thoda Pyaar Hua Tumse
Ke Thoda Ikraar Hua Tumse
Ke Zyada Bhi Hoga Tumhi Se
Ke Thoda Ikraar Hua Tumse

Meri Aankhon Ki Dua Hai
Yeh Chehra Tera
Ab Dekhe Bin Tujhe
Na Guzara Ho Mera

Meri Aankhon Ki Dua Hai
Yeh Chehra Tera Ab Dekhe Bin
Tujhe Na Guzara Ho Mera

Main Saans Bhi Loon
Tujhe Chahe Bina
Ab Hoga Na Yeh Humse

Ke Thoda Thoda Pyaar Hua Tumse
Ke Thoda Ikraar Hua Tumse
Ke Thoda Thoda Pyaar Hua Tumse
Ke Thoda Thoda Pyaar Hua Tumse

Ke Zyada Bhi Hoga Tumhi Se
Ke Thoda Thoda Pyaar Hua Tumse
Ke Thoda Thoda Pyaar Hua Tumse

Ke Zyada Bhi Hoga Tumhi Se
Ke Thoda Thoda Pyaar Hua Tumse

#4KSong