October 24, 2002

Search strategy for "Localized Google search result exclusions"

In a fascinating report:
"Localized Google search result exclusions Statement of issues and call for data"
http://cyber.law.harvard.edu/filtering/google/
authors Jonathan Zittrain and Benjamin Edelman examine sites excluded by Google from localized country-specific searching. Regarding search strategy, they suggest:

Since the filtering documented above may be but a part of such practices, we hope to augment our public database of such examples by seeding new searches with sites already known to be restricted, perhaps because someone simply searched on a known site and was surprised to find no results.

I found doing cross-correlation between, for example, US and German results from sites related to the banned sites, turns out to be extremely productive.

See http://www.google.com/help/operators.html#related

With just a little programming, I found banned in Germany:

http://pubweb.acns.nwu.edu/~abutz/
http://www.bloodandhonour.com/
http://www.ddc.net/ygg/
http://www.rudolf-hess.org/
http://www.ruf-ch.org/

(these are in addition to what had already been found)

Update - and for Google France, other sites, and directories such as:

http://dspace.dial.pipex.com/finalconflict/
http://home.inreach.com/dov/
http://www.efn.org/~iahu/
http://www.corax.org/revisionism/

Update:

Cross-correlation of results from sites which link to the banned sites also turns out to be fruitful. Though it requires some care to weed-out many old and repeated results.

See http://www.google.com/help/operators.html#link

For example, such cross-correlation found, for Google France:

http://dspace.dial.pipex.com/third-position/
http://www.demon.co.uk/natofeur/
http://www.ai.ee/users/revisjon/

http://www.biblebelievers.org.au/
http://www.iolaos.com/
http://www.flashback.net/
http://www.public-action.com/

By Seth Finkelstein | posted in censorware | on October 24, 2002 04:58 PM (Infothought permalink) | Followups

Seth Finkelstein's Infothought blog (Wikipedia, Google, censorware, and an inside view of net-politics) - Syndicate site (subscribe, RSS)

Subscribe with Bloglines      Subscribe in NewsGator Online  Google Reader or Homepage