Most Broncos are higher in the back, due to their load rating. The heavier duty rear springs held it up some, so that when you loaded it up with gear your headlights were not pointing at the sky.
There is also the possibility of sagging front springs, which is very common also.
So being level is normal for some, and being up in the rear is normal for others.
Rear tire carriers, full hard tops vs half cabs or soft tops, winch bumpers vs stock bumpers, back seats or not, dual tanks or not, all these things would have effected the ride height slightly from the factory. Just slightly, but enough that not all Broncos are precisely the same.
I don't know where you would find a consistent spot on the frame to measure this, but you can measure your suspension height between the top of the axle tubes and the bottom of the frame rails.
A stock Bronco is "approximately" 7 inches in the front and 6 inches in the rear.
If you are above this you have a lift, and if you are below this you have some spring sag.
However, even this is not an exact science, so I tell people to give themselves about a half-inch leeway in either direction. If yours is a half inch or less in either direction of 7" in the front and 6" in the rear, then it's close enough.
Since caster is read in reference to the ground, then yes a rear-high stance will change the caster reading. But since the caster is adjusted in reference to the axle-to-frame relationship, and is built in to a solid axle like ours, you can still run afoul of too much pinion angle if you try to over-compensate for lack of caster by installing c-bushings, offset ball joint sleeves, radius arm drop brackets, or even radius arms with built in caster correction.
The only method that is an actual "solution" to changing the caster numbers is the "cut-n-turn" method. That's where the steering yokes (where the ball joints are) are turned in relation to the axle tube they're pressed and welded on to. With this method you can achieve the perfect pinion angle AND the perfect caster angle for your particular setup. Since most are not wanting to get that deep into it at first, the c-bushings and all the other parts were developed.
Let us know what you find out and we'll keep digging into the issues.
Paul