This will happen if you have an animation playing, because the frame immediately goes to the next frame and your attachment visibility change is reverted, as if you had scrubbed the timeline. Could this be what happened? If not, is it possible to provide step by step instructions so we can see the problem?
