How to Implement GPT in Tensorflow | GPT-3, Transformer Implementation in TF
0
0
2,283,603 Views
Published on 12/19/22 / In
How-to & Learning
Hi friends,
This is the first video in a series on implementing a GPT-style model in Tensorflow. I scoured the web for days to find a video tutorial on Tensorflow and GPT-style transformer models to no avail. So I decided to make my own after reading through a dozen or so blog posts and PyTorch implementations.
Notable inspiration:
- https://colab.research.google.....com/github/d2l-ai/d2
- Apoory Nandan's Text Generation with Miniature GPT
- and many, many others.
I'm still learning this myself, so any questions or comments are valued. Thanks for your time.
Show more
0 Comments
sort Sort By