It could be deepseek, because Chloe (the ACC assistant) gets very scared and avoidant when topics like tiananmen square massacre, uyghur genocide and Taiwan get brought up, not to mention it functions similarly to chatgpt as many people have noticed, also claude and Llama 3.x/4 won't have a problem talking about the aforementioned topics, unlike deepseek. As for the token size, we still don't know, it really depends on the model and the hardware capabilities of the dev's setup, it could range from 8k-16k all the way up to 128k.
Perchance - Create a Random Text Generator
⚄︎ Perchance
This is a Lemmy Community for perchance.org, a platform for sharing and creating random text generators.
Feel free to ask for help, share your generators, and start friendly discussions at your leisure :)
This community is mainly for discussions between those who are building generators. For discussions about using generators, especially the popular AI ones, the community-led Casual Perchance forum is likely a more appropriate venue.
See this post for the Complete Guide to Posting Here on the Community!
Rules
1. Please follow the Lemmy.World instance rules.
- The full rules are posted here: (https://legal.lemmy.world/)
- User Rules: (https://legal.lemmy.world/fair-use/)
2. Be kind and friendly.
- Please be kind to others on this community (and also in general), and remember that for many people Perchance is their first experience with coding. We have members for whom English is not their first language, so please be take that into account too :)
3. Be thankful to those who try to help you.
- If you ask a question and someone has made a effort to help you out, please remember to be thankful! Even if they don't manage to help you solve your problem - remember that they're spending time out of their day to try to help a stranger :)
4. Only post about stuff related to perchance.
- Please only post about perchance related stuff like generators on it, bugs, and the site.
5. Refrain from requesting Prompts for the AI Tools.
- We would like to ask to refrain from posting here needing help specifically with prompting/achieving certain results with the AI plugins (
text-to-image-plugin
andai-text-plugin
) e.g. "What is the good prompt for X?", "How to achieve X with Y generator?" - See Perchance AI FAQ for FAQ about the AI tools.
- You can ask for help with prompting at the 'sister' community Casual Perchance, which is for more casual discussions.
- We will still be helping/answering questions about the plugins as long as it is related to building generators with them.
6. Search through the Community Before Posting.
- Please Search through the Community Posts here (and on Reddit) before posting to see if what you will post has similar post/already been posted.
Where's the bot that's behaving bad? These 2 URLs look to be Anthropic API to me:
https://perchance.org/ai-story-generator
And for the love of god, can you increase the token context window? If we are really using models that can remember more than 100k token
This specification is an absolute lie, most of the time. Most '128K' LLMs fall apart after 24K tokens or so, even big API ones. There are only a few worth anything past 64K.
In addition, it's also very hardware intense and slow to host very long context windows (the way most folks host them without knowing any better). If they're hitting APIs instead, its usually very expensive that way too, as there's no caching and they get charged for submitting 100K tokens with every turn.
I know, I don't need to prompt an entire book as lore, I am just asking for 15-20k.
Yeah, that's doable. But the context is likely low for cost reasons.
The writing UIs like that are pretty 'normal', formatted like Kobold or SillyTavern: https://lite.koboldai.net/
So you might consider dropping a few pennies on a legit dungeonmaster/text RPG finetune via some API, like openrouter. Hosting Claude or Llama like Perchance does for free is pretty generous, TBH.
The old model was way better, honestly. This one makes more mistakes, and tends to have characters act more wild and hostile during certain situations. It needs to be switched back to what it used to have. What was before was pleasant.