Color Coherence, Image -- Only Applying to First Frame?

When using a video input and selecting the "Image" mode for color coherence, the color scheme only applies to the first frame of the video and then reverts to the color scheme of the original input video. Is this a bug or am I making a mistake?

Thanks!