Skip to content

Summarize error loop #4263

@zanesq

Description

@zanesq

Describe the bug

Sometimes when chatting the model with plenty of tokens will respond with summarization but it fails. And it turns out to be another error that eventually shows Input is too long for the requested model after chatting again

To Reproduce
See attached screenshots

Expected behavior
If the error is indeed non recoverable with summarization it should show the error right away and not attempt summarization or show an option to summarize. Secondly how do we avoid hitting this Input is too long for the requested model error in the first place or better recover from it.

Screenshots

Image Image Image Image Image

Please provide following information:

  • OS & Arch: Mac arm
  • Interface: UI
  • Version: v1.4.1
  • Extensions enabled: redacted
  • Provider & Model: Sonnet

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions