Up next

How to Implement GPT in Tensorflow | GPT-3, Transformer Implementation in TF

2,283,603 Views· 12/19/22
Generative AI
Generative AI
3 Subscribers
3

Hi friends,

This is the first video in a series on implementing a GPT-style model in Tensorflow. I scoured the web for days to find a video tutorial on Tensorflow and GPT-style transformer models to no avail. So I decided to make my own after reading through a dozen or so blog posts and PyTorch implementations.

Notable inspiration:
- https://colab.research.google.....com/github/d2l-ai/d2
- Apoory Nandan's Text Generation with Miniature GPT
- and many, many others.

I'm still learning this myself, so any questions or comments are valued. Thanks for your time.

Show more

 0 Comments sort   Sort By


Up next