How did the early polar explorers navigate?

...in particular to relocate caches they had made along the way? And how did they know for certain they were at the exact north or south pole? This was long before gps, and compasses are erratic at high latitudes. No maps and few distinct landmarks. No radio beacons or lighthouses.