Skip to content

context shift allowing previous swipes to leak into newer generations #2425

Description

@wyattjvella-dot

when i have context shift turned on, i keep noticing that previous context kind of bleeds into the next swipe. if a character randomly decides to add 5 background characters breakdancing after 12 swipes of nothing happening, the next 10 swipes will all include something to do with 5 background characters doing something.

for example, if i throw a toothpaste cube at ram...
Image

...and then edit out the 'toothpaste' part...
Image
ram still perceives the cube as being a toothpaste cube.

i first tried restarting sillytavern and the problem persisted. when i restarted koboldcpp though the "last swipe" memory fades and the problem resets to 0 but is still there. so i trial and errored my koboldcpp settings until i eventually found that disabling context shifting fixes this issue. i'm not sure why, but as a person who relies on swipes very often, i just can't use context shifting

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions