Comments on: Stop Site Scraping

By: Attention: WordPress Bloggers, Is Someone Scraping Your Blog's RSS Feeds?

Attention: WordPress Bloggers, Is Someone Scraping Your Blog's RSS Feeds? — Fri, 12 Jun 2009 05:08:13 +0000

[...] If you have had enough of these people, you can stop them from HotLinking linking to your images, javascript, swf, and CSS files. Just modify your .htaccess file with the following code. Code provided by: Search-This [...]

By: Attention: WordPress Bloggers, Is Someone Scraping Your Blogs RSS Feeds?

Attention: WordPress Bloggers, Is Someone Scraping Your Blogs RSS Feeds? — Sun, 27 Jul 2008 03:52:02 +0000

[...] If you would like to stop people from HotLinking linking to your images, javascript, swf, and CSS files. Just modify your .htaccess file with the following code. Code provided by: Search-This [...]

By: Don’t get stressed about blog scrapers stealing your content

Don’t get stressed about blog scrapers stealing your content — Thu, 15 May 2008 18:15:28 +0000

[...] Blog Scraping – have you been a victim? How to protect yourself against Blog Post Theft and Splogs! Top 8 Excuses for Stealing Other People’s Content Six Steps to Prevent Content Theft and Combat Copyright Infringement on Your Business Blog The 6 Steps to Stop Content Theft How to deter thieves from stealing your images and server bandwidth Blog Plagiarism Q&A Stop Site Scraping [...]

By: Karl Groves

Karl Groves — Mon, 19 Mar 2007 10:54:13 +0000

I hate to be the bearer of bad news but these methods are not reliable. I decided to test to see if I could scrape this site. Typical methods with PHP and file() or file_get_contents() were blocked and simply returned a string that says “Stop Site Scraping”. However, your methods do nothing against a scraper using Curl. With 8 lines of Curl, I was able to retrieve this site completely. All the scraper would need to do then would their regular processing in order to put your data on their site.

Naturally, I won’t reproduce the code here, but if you know any Curl, its just a simple GET request.

At any rate, good luck. People stealing content suck.

By: Dan Schulz

Dan Schulz — Thu, 08 Mar 2007 04:47:00 +0000

This is just crazy. I know it goes on, but people just need to pull their heads out of wherever they’re shoving them and realize that they can’t get away with this kind of garbage forever.

Thanks for sharing the tip. Now to see if it works.

By: ses5909

ses5909 — Wed, 07 Mar 2007 10:27:59 +0000

Both. I wrote the post about my Merchant account site, but Mark is explaining how he has had the same thing happen to him.

By: John Loch

John Loch — Wed, 07 Mar 2007 09:10:59 +0000

Is the site in question replicating your merchant site content, or this ones (as in search-this.com) ?

By: Golgotha

Golgotha — Tue, 06 Mar 2007 21:37:30 +0000

Yes Tomas, I found out through tracking software (AWStats) and Technorati. In addition, I have received e-mails from people telling me so and so is scraping your site.

By: John Conde

John Conde — Tue, 06 Mar 2007 21:26:44 +0000

I actually found it while doing a routine ranking check for my site. My site is sandboxed (or however you wish to describe it) and appears for no quality keywords. But I check regularly anyway so I can tell when the dark cloud has lifted.

Anyway, one day I noticed I ranked moderately well for some decent search terms. I checked it out and it wasn’t my site but theirs. It’s bad enough I can’t get my site ranked but I don’t need them to rank well from my hard work. I have enough of an uphill battle and I don’t need my site to be seen as duplicate content to a site scraper.

By: TOMAS

TOMAS — Tue, 06 Mar 2007 21:21:30 +0000

Thanks for the informative post, we need more posts like this that help us thwart the bad guys and keep our content safe and secure! *hint* *hint*

Also, how did you figure out that the site scraping was going on in the first place? Was it through your visitor tracking software or Technorati?

By: Golgotha

Golgotha — Tue, 06 Mar 2007 21:13:38 +0000

Hey Ben, ST gets scraped by at least half a dozen sites. It typically doesn’t effect us because our pagerank is higher than the scrapers.

It has become an epidemic though.

By: Ben Partch

Ben Partch — Tue, 06 Mar 2007 17:01:07 +0000

Hello

Thanks for this. The site in question had scrapped my site also.

This was very helpful.

Also to anyone who reads this, I notice that the site in question has scrapped many, many sites just like mine and Sara’s/John’s.

Including but not limited to, this site Mark.

Now I am off to do all my other sites.