Long time no post… Remember Virgilio’s robots.txt issue (now fixed)?
I wasn’t too shocked today to discover that Netscape Search (whose results are also provided by Google) has the same “bug”: Netscape Search’s robots.txt file does not disallow /search.
As a result, Netscape Search has about 40,000 of its SERPs (that is, Google’s) in Google’s index. Check it out:
http://www.google.com/search?q=site%3Asearch.netscape.com%2Fsearch
The missing “Disallow: /search” is obviously an open door to search engine spammers (yes, some of those pages actually have good rankings).
Come on Netscape, fix that robots.txt!
0 Responses to “Netscape Search spamming Google”