Up next


How to Implement GPT in Tensorflow | GPT-3, Transformer Implementation in TF

2,283,597 Views
AI Lover
3
Published on 12/19/22 / In How-to & Learning

Hi friends,

This is the first video in a series on implementing a GPT-style model in Tensorflow. I scoured the web for days to find a video tutorial on Tensorflow and GPT-style transformer models to no avail. So I decided to make my own after reading through a dozen or so blog posts and PyTorch implementations.

Notable inspiration:
- https://colab.research.google.....com/github/d2l-ai/d2
- Apoory Nandan's Text Generation with Miniature GPT
- and many, many others.

I'm still learning this myself, so any questions or comments are valued. Thanks for your time.

Show more
0 Comments sort Sort By

Up next