My GPS readings are consistently in the wrong position. What am I doing wrong?

This is usually a datum problem. Make sure that the datum used by the map is the same as the datum set in the GPS. In the continental US this will usually be either NAD27-CONUS , NAD83, or WGS84. NAD83 and WGS84 are equivalent for a practical purposes. See this link for more details.