So I monitor the website visitor stats for our website at work - with all the usual caveats about visitors and sessions and hits, but have recently found a report in our logging software (LiveStats.XSP) which separates out the browser visits from the crawler/spider visits, and it surprised me…
Only 53% of visits to the site (so far this month) were from browsers, and Yahoo was top of the crawlers with (and this is what really surprised me) 42% of the visits. Next came MSN with 3% and Google with 0.5%. And this is consistantly the case over the previous months as well - Yahoo’s crawlers visiting our website 10 times as often as any other…
Is this normal?
Grim