While conversing with GovAI, the system will dynamically maintain a context window of your previous messages in order to inform its future responses.
It should feel intuitive and similar how we as humans converse. That is to say, you can add new information to your conversation and we make reference to past things that you've said in the conversation.
However, there are some limits and behaviours that can trip you up when using GovAI.
If you're having very long conversations with GovAI, where you continuously come back to the same thread and changing topics abruptly, this can cause it to have a difficult time to determine how much emphasis to put on our previous conversation items versus new ones.
Generally, we recommend keeping a focused conversation in a thread and simply creating a new thread to start discussing a new topic.
This seems intuitive and is reflected in the actual usage of GovAI today; when we looked at the number of message sent per thread we found that;
p99 | p95 | p50 |
38 Messages | 18 Messages | 4 Message |
99% of threads have 38 or fewer messages sent | 95% of threads have 38 or fewer messages sent | 50% of threads have 4 or fewer messages sent |
In order to help guide users on when they might want to consider using a new thread, we've added a little warning which displays once a thread has reached 50 messages sent.
This is not a limitation, you can go beyond that and certain use cases warrant this. The purpose of this is to help coach users that starting a new thread can help to you "reset the conversation" so GovAI doesn't factor in irrelevant content based on a new topic you want to discuss.