Up next


Text-generation-webui - SIMPLE install - Many AI characters - Supports Llama, GPT-Neo, etc

3,944 Views
AI Lover
3
Published on 06/02/23 / In How-to & Learning

ChatGPT has taken the world by storm and GPT4 is out soon. While that’s great, wouldn't you like to run your own chatbot, locally and for free (unlike GPT4)? No more queues, nothing to pay, a choice of models and the ability to create your own characters? What’s that? It doesn’t even need a GPU? Sounds too good to be true? Welcome to the text-generation-webui! A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, Pygmalion and many, many more! Whisper and TTS included, allowing you to speak to your characters and have them speak back too.

As with anything AI, you’ll have the very best experience of a simple, error free install every time on Linux.
For Microsoft Windows the exact same steps should also work, but as any Windows user knows anything could go wrong at any time!
As for Mac - not sure!

Thanks to huggingface there is a massive library of models, many with Open Source licenses just ready for you to use! Create any custom character you like and take it for a spin - even with just 8GB VRAM. Some models work with much less too 😀

If you don’t like standard installations, you can also use the obfuscated method. It’s just 3 steps:
1. Install using the 1-click installer
2. Download your model(s)
3. Start the webui!

See the pinned tweet for more links ;)

I’m pretty sure everyone will want to try this, so expect to see lots more of this interface as others catch on! Just remember where you saw it first - right here on the Nerdy Rodent channel!

== Links! ==
* Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
* How do I create an animated SD avatar? - https://youtu.be/Z7TLukqckR0
* Stable Diffusion Playlist! - https://youtube.com/playlist?l....ist=PLjC8P1vEncQDVOC

== Stable Diffusion Playlists ==
* Interested in adding things to your AI Art? Try these!
Dreambooth Playlist - https://youtube.com/playlist?l....ist=PLjC8P1vEncQD-QY
* Textual Inversion Playlist - https://youtube.com/playlist?l....ist=PLjC8P1vEncQDSDL

Note that GitHub repositories update often! Be sure to check the GitHub README for the current info ;)m

Show more
0 Comments sort Sort By

Up next