I have a really long/detailed chat. Why is the AI not remembering what we spoke about at the beginning?
Chat context in Novelcrafter.
1 min read Last updated Jan 15, 2025
Our chat interface currently reads up the last 25 messages in chat (roughly). This was done at a time where many models only had an 8k token context window (which obviously isn’t the case now).
We are actively reviewing this limit.
You can see where the data cut-off is by scrolling up the chat for the following icon:
