Thank you for the replies. I thought hard about the POV thing and I believe this is, in fact, what I was having trouble with.

I think I had one short POV flip that interrupted some dialogue between other characters. Removing that and leaving the minor character in the background while the others talk seems to have fixed the scene. There are still about 4 POVs in the scene, but they follow sequentially from one another, which seems to work well enough.

Thank you. So the trick is to change POV slowly and steadily, instead of jarring the attention to somebody who should be listening, not talking.

You live, you learn. I'll have to check my other scenes for that problem.