Creating A Custom Dataset For GPT Neo And GPT-J-6B(GPT3)

In this video, I go over how to create a custom dataset to finetune GPT Neo and GPT-J-6B. To do this, I create an AI quote generator.

Github: https://github.com/mallorbc/GPT_Neo_quotes_dataset

Timestamps

00:00 - Intro
00:29 - Quotes Dataset
01:59 - Code Overview
07:07 - Running The Code
07:54 - Looking At Generated Dataset
08:35 - Running The Fine-tuned Model
09:56 - Outro