I haven't experienced this, but a drop of blue locktite will fix it ... Just make sure it's blue, and not red !!
Tap it back flush, give it a shot of non-chlorinated brake cleaner/gun scrubber/alcohol/acetone (or finger polish remover, if that's all you have) and add 1 drop of locktite, once the solvent dries.