Ahh yes. The old arrow-tip stretchy thingy! Been awhile since I've yanked on one of them thar things.
Well, the good news is that at least it's not a metal bit that might get through the jets and into the engine. Nor is it likely to clog something up right away either. But it might end up floating free someday after some particularly hard bumps and jumps and end up sticking itself on top of a main jet. Would make for a crappy running engine for sure!
I can't remember again, but I think the walls on the pump cavity are pretty tall, but with a slot cut into them to transfer fuel into the pump? If so, it's probably ok for the short term.
But I go back to my first statement about not leaving stuff like that in there. I would just suck it up and pull it apart again myself.
Mind you, I wouldn't be any too happy about it. But I'd do it.
Paul