A clean, simple and readable from scratch implementation of the EfficientNet architecture (B0-B7) using the PyTorch library.

Original paper:
https://arxiv.org/abs/1905.11946

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Timestamps:
0:00 - Introduction
0:45 - Imports
1:00 - Architecture config
6:10 - Implementation Structure
7:10 - CNNBlock
10:10 - SqueezeExcitation
13:05 - InvertedResidualBlock (w. Stocasthic depth)
23:44 - EfficientNet
36:22 - Running a small test case
37:55 - Ending

In this video we understand how intersection over union works and we also implement it in PyTorch. This is a very important metric to understand when it comes to object detection as it is used pretty much all the time.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

Object Detection Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6Ijfw0Tp

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

0:00 - Introduction
01:12 - Explanation of IOU
09:52 - Coding in PyTorch

Sharing some thoughts about the channel and what it could be more long term, really appreciate the support from you guys.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

In this video I show an example of how to specify custom weight initialization for a simple network.

Pytorch init docs:
https://pytorch.org/docs/stable/nn.init.html


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

A from scratch implementation of SVM using the CVXOPT package in Python to solve the quadratic programming. Specifically implementation of soft margin SVM.

To understand the theory (which is a bit challenging) I recommend reading the following:
* http://cs229.stanford.edu/notes/cs229-notes3.pdf

* https://www.youtube.com/playli....st?list=PLoROMvodv4r (Lectures 6,7 by Andrew Ng)


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

This video is for those who want to get started doing #kaggle.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

👋 CONNECT WITH ME:
Twitter ► https://twitter.com/aladdinperzon
LinkedIn ► https://www.linkedin.com/in/al....addin-persson-a95384

In this video I walkthrough how to use a learning rate scheduler in a simple example of how to add it to our model.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this tutorial we build a Sequence to Sequence (Seq2Seq) model from scratch and apply it to machine translation on a dataset with German to English sentences, specifically the Multi30k dataset. There was a lot of things to go through and explain so the video is a bit longer than my normal videos, but I really felt I wanted to share my thoughts, explanations and the details of the implementation!

Resources I used and read to learn about Seq2Seq:
https://github.com/bentrevett
https://arxiv.org/abs/1409.3215
https://pytorch.org/tutorials/....intermediate/seq2seq

Comment on resources:
I think bentrevett on Github is awesome and I was heavily inspired in this video by his Seq2Seq Tutorials and I really recommend checking him out, he puts out a lot of great tutorials on his Github.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
1:27 - Imports
2:05 - Data processing using Torchtext
5:55 - Implementation of Encoder
11:02 - Implementation of Decoder
19:43 - Putting it togethor to Seq2Seq
27:57 - Setting up training of the network
41:03 - Fixing Errors
42:18 - Evaluation of the model
49:32 - Ending and Bleu score result

In this video we go through the most basic and essential tensor operations that really build the foundation to TensorFlow 2.0 and is important to know before moving on to building neural networks which we will start with in the next tutorial! :)

Knowledge in Linear Algebra is very important to have an easier time understanding many tensor operations we go through so I would view as a prerequisite. I think if you don't have that then this series by 3Blue1Brown can be helpful:
https://www.youtube.com/playli....st?list=PLZHQObOWTQD

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:48 - Imports
2:21 - Initialization methods for Tensors
8:34 - Casting to different types
9:36 - Mathematical Operations
15:16 - Indexing a Tensor
19:18 - Reshaping a Tensor
20:40 - Ending words

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

A clean, simple and readable implementation including pretrained weights on the zebras-horses dataset available on the Github repository if you'd like to evaluate the model :)

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Timestamps:
0:00 - Introduction
0:32 - CycleGAN summary
7:45 - Results paper vs our
8:49 - Outline for implementation
9:25 - Discriminator
17:00 - Generator
28:15 - Dataset
38:00 - Train function
57:55 - Ending

In this video we go through the network and code the VGG16 and also VGG13, VGG13, VGG19 in Pytorch from scratch.

The VGG Paper:
https://arxiv.org/abs/1409.1556


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE
0:00 - Introduction
0:19 - VGG Paper Review
3:38 - Coding the VGG

In this video we take a look at the Sequence Models in Recurrent Neural Network (RNN), Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM). We also see how these can be formed to be bidirectional.

If you're unfamiliar with Sequence models such as RNNs, GRUs, and LSTMS, I recommend:
https://www.youtube.com/playli....st?list=PL1F3ABbhcqa

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this video I explain how Einstein Summation (einsum) works and why it is amazing, at the end of the video you too will realize that einsum is all you need. It works similar in all libraries with the following function call: torch.einsum, tf.einsum, numpy.einsum (pytorch, tensorflow, numpy).

Video title was recklessly stolen from the following blogpost which I was inspired by (read it!):
https://rockt.github.io/2018/04/30/einsum

Also looked quite a bit at:
https://obilaniu6266h16.wordpr....ess.com/2016/02/04/e
https://ajcr.net/Basic-guide-to-einsum/

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

OUTLINE:
0:00 - Introduction
0:15 - What, Why and How
6:48 - Code examples
16:04 - Ending

Resources that was very useful for me when learning about GNNs that you can check out for more information and from which I've used in the slides:

Cs224w: https://youtube.com/playlist?l....ist=PLoROMvodv4rPLKx
https://distill.pub/2021/gnn-intro/
https://distill.pub/2021/understanding-gnns/
https://www.youtube.com/playli....st?list=PLV8yxwGOxvv
https://youtu.be/8owQBFAHw7E
https://youtu.be/uF53xsT7mjc
https://youtu.be/w6Pw4MOzMuo

0:00 Introduction
1:24 Why graphs
4:13 What is a graph
7:06 Common graph tasks
11:08 Representation of a graph
12:46 - How does a GNN work?
14:35 - Understanding information propagation
17:24 - Key property: Permutation Invariance
19:33 - Key property: Permutation Equivariance
22:22 - Message passing computation
23:53 - GNN Variant: Convolution
26:37 - GNN Variant: Attention
28:39 - Ending

Linear Regression implementation in Python using numpy library.

Github repository:
https://github.com/aladdinpers....son/Machine-Learning

More thorough derivation:
https://aladdinperzon.github.i....o/2020/03/25/Linear-

In this video we go through how to code the ResNet model and in particular ResNet50, ResNet101, ResNet152 from scratch using Pytorch.

ResNet Paper:
https://arxiv.org/abs/1512.03385


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:31 - Overview of the ResNet paper
6:40 - Coding ResNet