What Can Huge Neural Networks do?

An actually-open-AI model is available for you to download the weights to and tinker with, GPT-J. It's a 6 billion parameter large language model that can do long-form natural language generation, do programming, be a chatbot, do translations, and much more.

GPT-J Text examples: https://pythonprogramming.net/....GPT-J-6b-parm-transf
GPT-J Github: https://github.com/kingoflolz/mesh-transformer-jax
The Pile paper: https://arxiv.org/pdf/2101.00027.pdf
GPT-J Web demo: https://6b.eleuther.ai/
EleutherAI: https://www.eleuther.ai/
Multimodal Few-Shot Learning with
Frozen Language Models: https://arxiv.org/pdf/2106.13884.pdf

Neural Networks from Scratch book: https://nnfs.io
Channel membership: https://www.youtube.com/channe....l/UCfzlCWGWYyIQ0aLC5
Discord: https://discord.gg/sentdex
Reddit: https://www.reddit.com/r/sentdex/
Support the content: https://pythonprogramming.net/support-donate/
Twitter: https://twitter.com/sentdex
Instagram: https://instagram.com/sentdex
Facebook: https://www.facebook.com/pythonprogramming.net/
Twitch: https://www.twitch.tv/sentdex