Question about Missed Hits

Hey Rich

For months my hit count numbers on all of the "top sites" and the numbers my server is showing have not matched up. Can anyone help me understand whats going on with this, and fix the problem in my layout, ect that might be causeing the hits not to register? For example the "boaphile" hit count shows me as

Average Today Yesterday 2 Days Ago 3 Days Ago
Unique Pageviews 64.25 43 54 76 84
Total Pageviews 363.25 236 266 415 536
Unique Hits In 2.00 1 2 3 2
Total Hits In 2.50 2 2 4 2
Unique Hits Out 1.50 0 3 2 1
Total Hits Out 1.50 0 3 2 1

But my server shows my hit count as

Unique pageviews 134.93 78 118 172 142
Total Pageviews 1319.50 360 1093 2695 1484

Its been like this for months now, on all the counters. As such I have to believe either my servers count is wrong, or something is set up incorrectly on my site so the hits are not registering. Is it possible that my site takes to long to load on slower connections, as such the hits get missed by the top sites counters?