RTV? 24 hours? Clean it off.
Is the gasket stuck to one of the surfaces? If so I'd say that can stay if it's flat up against it's surface. If it's sitting on a thick, now dry bead of silicone though, remove it as well.
This is not important while the stuff is still tacky, as it will squeeze down. But once it's dried up, I'd say you need to start over. Not that it "can't" work by just adding some new junk to it, but you are the one that will have to pull it all off and re-do it if it does leak.
And I know that I sure would not want to be doing it twice!
Test fit, test fit, test fit, when it comes to swapped stuff.
Of course, the rest of the stuff is pretty much going to fit the cover, because it was made for it. The only things that were not meant for each other originally are the block and cover. So even after you remove the pump eccentric and perhaps get the correct bolt (maybe the old one is too long now?) trial fit the cover again before applying sealer again.
Proper torque of the cam bolt is important, and I like to use thread locker. Not sure if it's required or called up in the instructions, but lots of members will know that as they've done it more recently than me and can let us know if the extra step is needed.
With alignment and test-fitting in mind, and unless you still have the alignment dowels in the front of the block(?) I would leave all the bolts just barely snug/loose and then fit the damper up as soon as possible after, then snug down (not full torque yet) all the bolts you can get to.
As there are probably at least one or two that you can't really access with the damper on, you then remove the damper again to access all bolts and torque them down to spec.
This added hassle is to make sure that the cover and seal are centered on the damper shaft. If you have the dowels this is not necessary. But without them, you run the risk of a leaky front seal.
Lubricating the crankshaft snout and the outer surface of the damper not only help ease it into the seal, but also make it easier to remove if necessary.
You do not need to install the damper all the way. Just far enough to be forcing the seal and front cover to center themselves.
Again, if you have alignment dowels in the block, all that extra crap isn't really needed.
But I wanted to mention it just in case. Maybe others have better ways of doing it.
Good luck.
Paul