As you may know, there are a number of websites (such as wenda.io) that scrape content from StackOverflow (and other StackExchange sites). I couldn’t care less that they do this, and indeed they are at perfect liberty to do so as long as they attribute where they got it from (I’ve also done my fair share of reporting those sites that don’t do this), except these sites are polluting my search results.

The problem is that there are dozens of these sites, with new ones seeming to appear every day. They often appear right beside the corresponding Stack Overflow page, but sometimes they don’t. The sites themselves are usually terribly formatted and difficult to use, and of course don't have all the “related” boxes that I find super useful on Stack Overflow (though they have their own poor imitations). Furthermore, I don’t want to support these sites by using them.

Is there a simple way to exclude these scraper sites from Google search results? (I'd be happy if you could find a solution for DuckDuckGo too.) Note that I don't want only SO search results, because then that would exclude all the other non-SO stuff that also helps me.

Here’s an example search on DuckDuckGo (as of 4 Sept 2015) where 11 of the 30 results on the first page are from Stack Overflow scrapers. Google has quite a few Stack Overflow scrapers too, though it also has lot of results that don’t show up on DuckDuckGo that are mixed in.

Edit: I was looking for solutions specifically for StackExchange sites, and more specifically, StackOverflow. The question that is marked as a duplicate is similar enough that it could be a duplicate, depending on if specificity is taken into account (but it certainly doesn't answer my question, but then, neither do any of the answers here).

  • 1
    If you want to block a site, you can add -site:url.com in to the end of your query. If you only want to find SO (and nothing else) you can always just use site:stackoverflow.com – Jon Sep 4 '15 at 16:50
  • 1
    Like I said, there are dozens of these sites, with new ones appearing all the time. I don't have a definitive list of them. I also said I don't want just SO results. I already know how to do that. – user103148 Sep 4 '15 at 16:52
  • 1
    FWIW, the way Google deals with them is the best—and most elegant—solution which is to make sure Stack Exchange sites show up at the top of results in the vast majority of cases. Google respects Stack Exchange sites and as a result Stack Exchange sites are pretty much always at the “top of the heap” when doing searches on some topics. – Giacomo1968 Sep 4 '15 at 16:53
  • And why was this moved from superuser? Isn't this exactly what a "power user" question is? – user103148 Sep 4 '15 at 16:58
  • 1
    @JakeGould: Good point. – user103148 Sep 4 '15 at 18:00

If you're using the Chrome Browser, Goole has released the Personal Blocklist extension

The personal blocklist extension will transmit to Google the patterns that you choose to block. When you choose to block or unblock a pattern, the extension will also transmit to Google the URL of the web page on which the blocked or unblocked search results are displayed.

| improve this answer | |
  • That looks like it might work, if I only used Chrome. Good answer. But I use Chrome only in a minority of cases. – user103148 Sep 4 '15 at 16:54
  • Even though this doesn't work for me, it may work for others, so I'll mark this as the answer. – user103148 Sep 4 '15 at 22:16