this post was submitted on 17 Sep 2024
1 points (66.7% liked)

Perchance - Create a Random Text Generator

392 readers
6 users here now

⚄︎ Perchance

This is a Lemmy Community for perchance.org, a platform for sharing and creating random text generators.

Feel free to ask for help, share your generators, and start friendly discussions at your leisure :)

This community is mainly for discussions between those who are building generators. For discussions about using generators, especially the popular AI ones, the community-led Casual Perchance forum is likely a more appropriate venue.

See this post for the Complete Guide to Posting Here on the Community!

Rules

1. Please follow the Lemmy.World instance rules.

2. Be kind and friendly.

  • Please be kind to others on this community (and also in general), and remember that for many people Perchance is their first experience with coding. We have members for whom English is not their first language, so please be take that into account too :)

3. Be thankful to those who try to help you.

  • If you ask a question and someone has made a effort to help you out, please remember to be thankful! Even if they don't manage to help you solve your problem - remember that they're spending time out of their day to try to help a stranger :)

4. Only post about stuff related to perchance.

  • Please only post about perchance related stuff like generators on it, bugs, and the site.

5. Refrain from requesting Prompts for the AI Tools.

  • We would like to ask to refrain from posting here needing help specifically with prompting/achieving certain results with the AI plugins (text-to-image-plugin and ai-text-plugin) e.g. "What is the good prompt for X?", "How to achieve X with Y generator?"
  • See Perchance AI FAQ for FAQ about the AI tools.
  • You can ask for help with prompting at the 'sister' community Casual Perchance, which is for more casual discussions.
  • We will still be helping/answering questions about the plugins as long as it is related to building generators with them.

6. Search through the Community Before Posting.

  • Please Search through the Community Posts here (and on Reddit) before posting to see if what you will post has similar post/already been posted.

founded 1 year ago
MODERATORS
 

Is it possible to self-host some of the generators (for security purposes) I have a computer quite capable of running many of the models, and indeed have a number available already. I have python available and can install any addons needed -- I just dont know how to utilize the plugins etc that are available here

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 day ago* (last edited 1 day ago)

It's definitely possible, since all the code for generators on Perchance is openly available and downloadable, but currently there's unfortunately no "one-click" way to do this right now - and it still would require a bit of coding knowledge at this point.

I think I wrote a comment related to this a few months back - basically you'd need to use something like ollama or llama.cpp or tabbyAPI or Aphrodite or vLLM or TGI (....etc) to run the AI text gen model (and for image gen, ComfyUI or Forge WebUI). Unfortunately even a top-of-the-line gaming GPU like a 4090 is not enough to run 70B text gen models fully in VRAM, so it may be slow. And then you'd need swap out some code in perchance.org/ai-text-plugin and perchance.org/text-to-image-plugin so that it references your localhost API instead of Perchance's server. You'd just fork the plugins, make the changes, then swap out the imports of the ai plugin for your new copies in the gens you want to self-host.

Someone in the community with some coding experience could do the work to make this easier for non-coders, and hopefully they share it in this forum if they do. I'll likely get around to implementing something eventually, but probably won't have time in the near future.