Sounds like either the rod is not adjusted properly, or there is some flex somewhere that's not allowing linear action.
How does the passenger side work? No problem there? Usually not as much, since they don't often get used as much, but sometimes they have issues of their own as well.
The amount of pull should be very minimal.
I'm trying to remember if the actuating rod is adjustable there or not. Seems like it is.
Memory is flawed, 'cause I was just tweaking around with mine last month to get them to work.
My driver's side was not only hard to pull (very hard!) but took up more travel than was expected. Still worked, but the amount of force made me worried that it would break the lever arm first. They're a well known failure point if things aren't dealt with soon.
How hard is yours to pull?
In my case, lubing everything up cured 80% of the trouble. I don't remember adjusting the rod, but I had them all out at one point too, and put them all back in adjusted the best I could.
Good luck.
Paul