A from scratch implementation of SVM using the CVXOPT package in Python to solve the quadratic programming. Specifically implementation of soft margin SVM.

To understand the theory (which is a bit challenging) I recommend reading the following:
* http://cs229.stanford.edu/notes/cs229-notes3.pdf

* https://www.youtube.com/playli....st?list=PLoROMvodv4r (Lectures 6,7 by Andrew Ng)


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

This video is for those who want to get started doing #kaggle.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

👋 CONNECT WITH ME:
Twitter ► https://twitter.com/aladdinperzon
LinkedIn ► https://www.linkedin.com/in/al....addin-persson-a95384

In this video I walkthrough how to use a learning rate scheduler in a simple example of how to add it to our model.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this tutorial we build a Sequence to Sequence (Seq2Seq) model from scratch and apply it to machine translation on a dataset with German to English sentences, specifically the Multi30k dataset. There was a lot of things to go through and explain so the video is a bit longer than my normal videos, but I really felt I wanted to share my thoughts, explanations and the details of the implementation!

Resources I used and read to learn about Seq2Seq:
https://github.com/bentrevett
https://arxiv.org/abs/1409.3215
https://pytorch.org/tutorials/....intermediate/seq2seq

Comment on resources:
I think bentrevett on Github is awesome and I was heavily inspired in this video by his Seq2Seq Tutorials and I really recommend checking him out, he puts out a lot of great tutorials on his Github.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
1:27 - Imports
2:05 - Data processing using Torchtext
5:55 - Implementation of Encoder
11:02 - Implementation of Decoder
19:43 - Putting it togethor to Seq2Seq
27:57 - Setting up training of the network
41:03 - Fixing Errors
42:18 - Evaluation of the model
49:32 - Ending and Bleu score result

In this video we go through the most basic and essential tensor operations that really build the foundation to TensorFlow 2.0 and is important to know before moving on to building neural networks which we will start with in the next tutorial! :)

Knowledge in Linear Algebra is very important to have an easier time understanding many tensor operations we go through so I would view as a prerequisite. I think if you don't have that then this series by 3Blue1Brown can be helpful:
https://www.youtube.com/playli....st?list=PLZHQObOWTQD

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:48 - Imports
2:21 - Initialization methods for Tensors
8:34 - Casting to different types
9:36 - Mathematical Operations
15:16 - Indexing a Tensor
19:18 - Reshaping a Tensor
20:40 - Ending words

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

A clean, simple and readable implementation including pretrained weights on the zebras-horses dataset available on the Github repository if you'd like to evaluate the model :)

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Timestamps:
0:00 - Introduction
0:32 - CycleGAN summary
7:45 - Results paper vs our
8:49 - Outline for implementation
9:25 - Discriminator
17:00 - Generator
28:15 - Dataset
38:00 - Train function
57:55 - Ending

In this video we go through the network and code the VGG16 and also VGG13, VGG13, VGG19 in Pytorch from scratch.

The VGG Paper:
https://arxiv.org/abs/1409.1556


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE
0:00 - Introduction
0:19 - VGG Paper Review
3:38 - Coding the VGG

In this video we take a look at the Sequence Models in Recurrent Neural Network (RNN), Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM). We also see how these can be formed to be bidirectional.

If you're unfamiliar with Sequence models such as RNNs, GRUs, and LSTMS, I recommend:
https://www.youtube.com/playli....st?list=PL1F3ABbhcqa

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this video I explain how Einstein Summation (einsum) works and why it is amazing, at the end of the video you too will realize that einsum is all you need. It works similar in all libraries with the following function call: torch.einsum, tf.einsum, numpy.einsum (pytorch, tensorflow, numpy).

Video title was recklessly stolen from the following blogpost which I was inspired by (read it!):
https://rockt.github.io/2018/04/30/einsum

Also looked quite a bit at:
https://obilaniu6266h16.wordpr....ess.com/2016/02/04/e
https://ajcr.net/Basic-guide-to-einsum/

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

OUTLINE:
0:00 - Introduction
0:15 - What, Why and How
6:48 - Code examples
16:04 - Ending

Resources that was very useful for me when learning about GNNs that you can check out for more information and from which I've used in the slides:

Cs224w: https://youtube.com/playlist?l....ist=PLoROMvodv4rPLKx
https://distill.pub/2021/gnn-intro/
https://distill.pub/2021/understanding-gnns/
https://www.youtube.com/playli....st?list=PLV8yxwGOxvv
https://youtu.be/8owQBFAHw7E
https://youtu.be/uF53xsT7mjc
https://youtu.be/w6Pw4MOzMuo

0:00 Introduction
1:24 Why graphs
4:13 What is a graph
7:06 Common graph tasks
11:08 Representation of a graph
12:46 - How does a GNN work?
14:35 - Understanding information propagation
17:24 - Key property: Permutation Invariance
19:33 - Key property: Permutation Equivariance
22:22 - Message passing computation
23:53 - GNN Variant: Convolution
26:37 - GNN Variant: Attention
28:39 - Ending

Linear Regression implementation in Python using numpy library.

Github repository:
https://github.com/aladdinpers....son/Machine-Learning

More thorough derivation:
https://aladdinperzon.github.i....o/2020/03/25/Linear-

In this video we go through how to code the ResNet model and in particular ResNet50, ResNet101, ResNet152 from scratch using Pytorch.

ResNet Paper:
https://arxiv.org/abs/1512.03385


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:31 - Overview of the ResNet paper
6:40 - Coding ResNet

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

In this video we build a simple generative adversarial network based on fully connected layers and train it on the MNIST dataset. It's far from perfect, but it's a start and will lead us to implement more advanced and better architectures in upcoming videos.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:29 - Building Discriminator
2:14 - Building Generator
4:36 - Hyperparameters, initializations, and preprocessing
10:14 - Setup training of GANs
22:09 - Training and evaluation

In this video we build on the previous video and add regularization through the ways of L2-regularization and Dropout. There are more ways of regularization such as Early Stoppage and Data Augmentation which we will also look at in future videos, but for now we keep it simple and use L2 and Dropout!

Resource/Prerequisite videos (Specifically the videos about Regularization):
https://www.youtube.com/playli....st?list=PLkDaE6sCZn6

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

A clean, simple and readable implementation of ProGAN including pretrained weights available on the Github repository if you'd like to evaluate the model :)

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Timestamps:
0:00 - Introduction
0:54 - Summary of ProGAN
14:07 - Results of implementation
16:00 - Model implementation
1:06:13 - Training setup
1:26:22 - Evaluation
1:27:58 - Ending

In this tutorial we go through the basics you need to know about the basics of tensors and a lot of useful tensor operations. I believe knowing about these operations are an essential part of Pytorch and is a foundation that will help as you go further in your deep learning journey. Pytorch is in many ways an extension of NumPy with the ability to work on the GPU and these operations are very similar to what you would see in NumPy so knowing this will also allow you to quicker learn NumPy in the future.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE
0:00 - Introduction
1:26 - Initializing a Tensor
12:30 - Converting between tensor types
15:10 - Array to Tensor Conversion
16:26 - Tensor Math
26:35 - Broadcasting Example
28:38 - Useful Tensor Math operations
35:15 - Tensor Indexing
45:05 - Tensor Reshaping Dimensions (view, reshape, etc)
54:45 - Ending words