I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

In this video we build a simple generative adversarial network based on fully connected layers and train it on the MNIST dataset. It's far from perfect, but it's a start and will lead us to implement more advanced and better architectures in upcoming videos.

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:29 - Building Discriminator
2:14 - Building Generator
4:36 - Hyperparameters, initializations, and preprocessing
10:14 - Setup training of GANs
22:09 - Training and evaluation

In this video we build on the previous video and add regularization through the ways of L2-regularization and Dropout. There are more ways of regularization such as Early Stoppage and Data Augmentation which we will also look at in future videos, but for now we keep it simple and use L2 and Dropout!

Resource/Prerequisite videos (Specifically the videos about Regularization):
https://www.youtube.com/playli....st?list=PLkDaE6sCZn6

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

A clean, simple and readable implementation of ProGAN including pretrained weights available on the Github repository if you'd like to evaluate the model :)

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
Github - https://github.com/aladdinpersson

GAN Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfwIp8

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Timestamps:
0:00 - Introduction
0:54 - Summary of ProGAN
14:07 - Results of implementation
16:00 - Model implementation
1:06:13 - Training setup
1:26:22 - Evaluation
1:27:58 - Ending

In this tutorial we go through the basics you need to know about the basics of tensors and a lot of useful tensor operations. I believe knowing about these operations are an essential part of Pytorch and is a foundation that will help as you go further in your deep learning journey. Pytorch is in many ways an extension of NumPy with the ability to work on the GPU and these operations are very similar to what you would see in NumPy so knowing this will also allow you to quicker learn NumPy in the future.

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE
0:00 - Introduction
1:26 - Initializing a Tensor
12:30 - Converting between tensor types
15:10 - Array to Tensor Conversion
16:26 - Tensor Math
26:35 - Broadcasting Example
28:38 - Useful Tensor Math operations
35:15 - Tensor Indexing
45:05 - Tensor Reshaping Dimensions (view, reshape, etc)
54:45 - Ending words

I was inspired to make these videos by this specialization: https://bit.ly/3SqLuA6

A clean, simple and readable implementation of SRGAN :)

Github: https://github.com/aladdinpers....son/Machine-Learning

GitHub Repository:
https://github.com/aladdinpersson/Mac...​

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpe...​

❤️ Become a Channel Member:
https://www.youtube.com/channel/UCkzW...​

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH​
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson​
LinkedIn - https://www.linkedin.com/in/aladdin-p...​
Github - https://github.com/aladdinpersson​

GAN Playlist:
https://youtube.com/playlist?list=PLh...​

PyTorch Playlist:
https://www.youtube.com/playlist?list...​

Timestamps:
0:00​ - Introduction and Overview
1:40 - Model implementation
24:48 - VGG Loss Term
28:20 - Quick review of train, utils, config file
36:42 - Ending

In this video we go through how to code a simple bidirectional LSTM on the very simple dataset MNIST. The focus is just on creating the class for the bidirectional rnn rather than the entire training part which I have done in several previous videos.

Previous video where we create the general training structure:
https://youtu.be/Jy4wM2X21u0

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this video we read the original transformer paper "Attention is all you need" and implement it from scratch!

Attention is all you need paper:
https://arxiv.org/abs/1706.03762

A good blogpost on Transformers:
http://www.peterbloem.nl/blog/transformers

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

OUTLINE:
0:00 - Introduction
0:54 - Paper Review
11:20 - Attention Mechanism
27:00 - TransformerBlock
32:18 - Encoder
38:20 - DecoderBlock
42:00 - Decoder
46:55 - Putting it togethor to form The Transformer
52:45 - A Small Example
54:25 - Fixing Errors
56:44 - Ending

Semantic segmentation with U-NET implementation from scratch.

You'll learn about:
✔️How to implement U-Net
✔️Setting up training and everything else :)

Original paper: https://arxiv.org/abs/1505.04597
My paper review: https://youtu.be/oLvmLJkmXuc

✅ Dataset used: https://www.kaggle.com/c/carva....na-image-masking-cha

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

⌚️ Timestampo:
0:00 - Introduction
1:03 - Model from scratch
22:20 - Dataset from scratch
29:50 - Training from scratch
39:48 - Utils (almost) from scratch
50:10 - Evaluation and Ending

In this video I show how to implement linear regression using the normal equation. If you want to check out the derivation I made a blog post that you can check out: https://aladdinperzon.github.i....o/2020/03/25/Linear-
People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Facial Keypoint Detection Kaggle Competition Solution! This solution is very simple but gives arelatively okay score and I share some thoughts on how you could improve it further (comparing with the winning solution).

Code (go to ML, Kaggle subdirectory): https://github.com/aladdinpers....son/Machine-Learning
Kaggle: https://www.kaggle.com/c/facia....l-keypoints-detectio


Timestamps:
0:00 - Introduction to competition
0:52 - Why?
1:22 - The data and the task
3:13 - Metric used
3:43 - A more in depth look at the data
7:24 - The steps of the solution
10:00 - Code: config
13:00 - Code: dataset
18:52 - Code: split_data
20:32 - Understanding submission format
21:57 - Code: utils
26:07 - Code: train/main file
31:22 - Fixing a small error
32:05 - Checking the score of submission
32:40 - How to improve it further?
34:55 - My 2 things to try for improving the score
35:15 - Ending & my thoughts on Kaggle

In this video I show you the freakishly difficult task of setting up and installing the latest tensorflow version with GPU support on Windows 10 :)

GO HERE FIRST:
https://www.tensorflow.org/install/source#gpu

1. Microsoft Visual Studio
* https://visualstudio.microsoft.com/vs/community/

2. the NVIDIA CUDA Toolkit
* https://developer.nvidia.com/cuda-toolkit-archive

3. NVIDIA cuDNN
* https://developer.nvidia.com/cudnn

4. Python (check compatible version from first link)
conda create --name tf_2.4 python==3.8

5. Tensorflow (with GPU support)
pip install tensorflow

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://youtube.com/playlist?l....ist=PLhhyoLH6IjfxVOd

Welcome to the first tutorial in this TensorFlow 2.0 Beginner Course! In this video we install TensorFlow (with GPU or CPU) and setup a deep learning environment with Anaconda and PyCharm.

Google Colab:
https://colab.research.google.....com/notebooks/intro.

Installation of Anaconda and PyCharm:
https://www.anaconda.com/products/individual
https://www.jetbrains.com/pycharm/download/

Check GPU Compute Capability (TF needs 3.5 or higher):
https://developer.nvidia.com/cuda-gpus

Download NVIDIA Drivers:
https://www.nvidia.com/Download/index.aspx

I learned a lot and was inspired to make these TensorFlow videos by the TensorFlow Specialization on Coursera. Below you'll find both affiliate and non-affiliate links, the pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
affiliate: https://bit.ly/3t3tgI5
non-affiliate: https://bit.ly/3kZgN5B

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

TensorFlow Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

In this video I show you how to calculate the mean and std across multiple channels of the data you're working with which you will normally then use for normalization to obtain a 0 mean and standard deviation (std) of 1.


People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Let's say you have a model that is working but now you want to be able to save a checkpoint and load it to continue training at a later point. In this video I walkthrough an example of how to do it!

People often ask what courses are great for getting into ML/DL and the two I started with is ML and DL specialization both by Andrew Ng. Below you'll find both affiliate and non-affiliate links if you want to check it out. The pricing for you is the same but a small commission goes back to the channel if you buy it through the affiliate link.
ML Course (affiliate): https://bit.ly/3qq20Sx
DL Specialization (affiliate): https://bit.ly/30npNrw
ML Course (no affiliate): https://bit.ly/3t8JqA9
DL Specialization (no affiliate): https://bit.ly/3t8JqA9

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Albumentations is the way to go. I really like this library and I think you will too!

GitHub Repository:
https://github.com/aladdinpers....son/Machine-Learning

✅ Equipment I use and recommend:
https://www.amazon.com/shop/aladdinpersson

❤️ Become a Channel Member:
https://www.youtube.com/channe....l/UCkzW5JSFwvKRjXABI

✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
Ethereum: 0xc84008f43d2E0bC01d925CC35915CdE92c2e99dc

▶️ You Can Connect with me on:
Twitter - https://twitter.com/aladdinpersson
LinkedIn - https://www.linkedin.com/in/al....addin-persson-a95384
GitHub - https://github.com/aladdinpersson

PyTorch Playlist:
https://www.youtube.com/playli....st?list=PLhhyoLH6Ijf

Image stolen from this awesome article:
https://medium.com/pytorch/mul....ti-target-in-albumen

Timestamps:
0:00 - Introduction
1:21 - Augmentation for Classification
9:11 - Augmentation for Segmentation
11:55 - Augmentation for Detection
21:35 - Full PyTorch Example
31:05 - Ending

Steps to get started:

1. Install miniconda
https://docs.conda.io/en/latest/miniconda.html

2. Clone or download Stable Diffusion:
https://github.com/CompVis/stable-diffusion

3. Download weights for model:
https://huggingface.co/CompVis..../stable-diffusion-v-

4. Run text2img or img2img script in conda terminal as shown in video. Example:

python scripts/txt2img.py --prompt "a photograph of an astronaut riding a horse" --plms

Timestamps:
0:00 - Introduction
1:36 - GitHub Repo
5:23 - Clone Repository
6:10 - Create conda env
6:45 - Running script
8:10 - Arguments
11:30 - Example run
12:40 - Image to image example
15:40 - Understanding scale and steps
18:10 - Removing safety lol
18:45 - Ending