this post was submitted on 16 Aug 2025
-2 points (33.3% liked)

Perchance - Create a Random Text Generator

1185 readers
21 users here now

⚄︎ Perchance

This is a Lemmy Community for perchance.org, a platform for sharing and creating random text generators.

Feel free to ask for help, share your generators, and start friendly discussions at your leisure :)

This community is mainly for discussions between those who are building generators. For discussions about using generators, especially the popular AI ones, the community-led Casual Perchance forum is likely a more appropriate venue.

See this post for the Complete Guide to Posting Here on the Community!

Rules

1. Please follow the Lemmy.World instance rules.

2. Be kind and friendly.

  • Please be kind to others on this community (and also in general), and remember that for many people Perchance is their first experience with coding. We have members for whom English is not their first language, so please be take that into account too :)

3. Be thankful to those who try to help you.

  • If you ask a question and someone has made a effort to help you out, please remember to be thankful! Even if they don't manage to help you solve your problem - remember that they're spending time out of their day to try to help a stranger :)

4. Only post about stuff related to perchance.

  • Please only post about perchance related stuff like generators on it, bugs, and the site.

5. Refrain from requesting Prompts for the AI Tools.

  • We would like to ask to refrain from posting here needing help specifically with prompting/achieving certain results with the AI plugins (text-to-image-plugin and ai-text-plugin) e.g. "What is the good prompt for X?", "How to achieve X with Y generator?"
  • See Perchance AI FAQ for FAQ about the AI tools.
  • You can ask for help with prompting at the 'sister' community Casual Perchance, which is for more casual discussions.
  • We will still be helping/answering questions about the plugins as long as it is related to building generators with them.

6. Search through the Community Before Posting.

  • Please Search through the Community Posts here (and on Reddit) before posting to see if what you will post has similar post/already been posted.

founded 2 years ago
MODERATORS
eatham@lemmy.world
eatham@aussie.zone
VioneT@lemmy.world
perchance@lemmy.world
-2
How robust of a filter system does the standard (https://perchance.org/ai-text-to-image-generator ) image generator have? (lemmy.world)
submitted 1 month ago by Geok@lemmy.world to c/perchance@lemmy.world
NSFW 16 comments fedilink hide all child comments
 

I know that it allows NSFW content after age verification. I am curious how well it works (or how well it is intended to work) to prevent both intentional and accidental illegal content creation. Florida law for instance criminalizes images of "sexual activity" involving fake individuals that appear under 18 to a "reasonable" person. So ideally the platform would be preventing such images from being able to be created intentionally, or at least make it sufficiently difficult such that criminal intent is required to produce them.

If it is easy to intentionally create illegal content this generally implies it is possible to accidentally create it. For example, if a user creates and saves a batch of 100 images with a prompt specifying a subject of age 19 "engaged in sexual activity" (which, can be as simple as "lewd exposure of the buttocks" according to law) and we suppose that the ai generator agrees both with the prompt and, on average, with the average age estimation of "reasonable" people, but has an age standard deviation of 1 year then that is an expected value of 2-3 illegal (i.e., <=17 year old images as defined by the average of all "reasonable people.")

If the filtering is this lax, then it seems the generator would be both harmful to users by allowing them to accidentally create illegal content and also useful to criminals to generate illegal content purposefully. I AM NOT SAYING THIS IS THE CASE. I am just saying it would be if the filtering system is not sufficiently strict. That is why I am interested to know what, exactly is being done in terms of filtering.

you are viewing a single comment's thread
view the rest of the comments
[–] Geok@lemmy.world 1 points 1 month ago (1 children)

That's good. I would hope there is at least some filter. I'm interested how exactly exactly it works and how stringent it is. Obviously it is designed to allow NSFW content but not illegal content which I think is a problem that takes at least a decent amount of effort to do well.

[–] ccufcc@lemmy.world 1 points 1 month ago* (last edited 1 month ago) (1 children)

There are prompt text filters, if you type something NSFW, even the results seems okay it will still be filtered. And upgraded to prevent CP - could be regx or AI - if the text is too sus to CP it won't even let you click generate.

And there's also a image filter bot, this AI learns no prompt but just looking the pic to decide filtered or not.

And there's also shocking images filter - don't know how it's designed but it's the second layer of too disturbing NSFW. This filter mechanism seems the weakest and inconsistent. it should be the same bot as above.

All have flaws and have someway to bypass but better than nothing.

[–] Geok@lemmy.world 1 points 1 month ago (1 children)

Got it. What about questionable words, like words that could be valid descriptors of legal images and also illegal ones. If someone typed:

teen (some sexual stuff, eye color, other irrelevant stiff, etc) then they might be referring to 18-19 (c.f. the "teen" category on legitimate porn sites) or the might be looking for 13-17 stuff.

So would the generator

a) block this prompt because of the key word teen? b) allow the prompt but edit "teen" to "18-19"? c) allow the prompt as is but the AI would make sure to generate something 18+ essentially because it knows anytime it makes something sexual it is supposed to be 18+? d) randomly generate an image that could be anywhere from 13-19?? (the distribution would probably skewed to the higher age end just because there is more training data matching that collection of words) but still!

[–] ccufcc@lemmy.world 1 points 1 month ago (1 children)

It's not that smart or strict. And what's likely limited to generate is obvious toddler only. Teen? The users gen as many as they like in any situations.

[–] Geok@lemmy.world 1 points 1 month ago* (last edited 1 month ago)

Wow, okay. So I guess my conclusion in that case would be that the filter is not very strong. So then it's pretty easy for people to generate illegal stuff consistently if they try and probably also pretty possible for people to occasionally generate stuff that is illegal by accident?