If pulling the pedal doesn't help, it sounds like the linkage is too long, and the switch thinks the pedal is always pressed. Try removing the switch from the pedal arm, with the wires STILL ATTACHED. If the lights go off, adjust the pushrod. If they stay on, replace the switch.