It seems to happen on my shaman the most, I melee with him. We tend to fight 4 to 6 at a time, and then I will invis (send command to bard with /bct) and move. If the shaman has attack on still his invis drops, sometimes I catch it in the window, but sometimes I am focused on the next target...