I am not aware of any rubber seals in a hydraulic lifter. Is this a new motor? Where are you finding these black pieces at?
If you are finding small, black pieces of plastic in the oil pan of an old motor, it's more than likely pieces from the original, plastic-coated timing gear on the cam. Time to get a new timing gear set:-X