Problem/Motivation

Token exhaustion exploitation is becoming a problem and although this generally can be configured at the assistant level, it makes sense to just deny right away via chat if a character limit is exceeded.

We should:

  • Add a character limit config
  • Report back a message to the user if limit is exceeded
  • Deny the chat from going to the remote

Comments

b_sharpe created an issue.