I've seen those installed that didn't have any problems either.
But the first several times I came across them, it was because a truck was in for service with regard to "funny noises" and "loose "stuff" up front" and other vague reasons.
When pulled apart, the inner hub section (aluminum) had been nicely machined down until, in some cases, they were literally worn through into the inner mechanism and no longer even remotely useable.
In theory, as long as everything is moving along in unison and correctly, the spring will just stay static against the back of the aluminum slug. But in practice, if anything catches on anything that's spinning in a different plane or at a different rate than the other stuff, instant lathe action!
It's pretty messy when it goes wrong. So my recommendation is to always remove it, like yesterday, and do not pass GO until you do it.
Lucky is good, but correct is safer.
Paul