Local model specifically for storywriting/chapter book-like?
r/LocalLLaMA
•
Generative AI
- 16gb vram - 96gb ram A lot of modern models are instruct models that are trained on shortform turn based roleplay and instinctively expect a user's input (instruct). When under a prompt that asks for longform stories, this causes a lot of them to have premature/implied endings or are generally unskilled at making its writing feel like something youd find in a chapter book. ive been using SillyTavern as my frontend as i mainly use AI for fun.