Stopping abuse
by Volker Weber
I need to block abusive spiders. Not those run by search engines but users who download the whole site using some Mozilla plugin. I have no idea who wants thousands of old pages, but there have been two incidents now where people have not only downloaded the site once but actually twice.
I am thinking about adding a throttle, along the lines of "more than 30 requests per minute and your IP is blocked". Has anybody seen anything like this?
Update: Nils has provided a good hint (see comments). You can now request 15 pages in 60 seconds, which should be enough for everyone. If you exceed that rate, your IP is blocked for 60 seconds. That should stop robots but not humans.
Comments
something like this?
PHP Classes - Class: Flood Recorder
http://www.phpclasses.org/browse/package/2268.html
it might have been google's recently 'recalled' web-accellerator plug-in.
do you use "Flood Recorder" or did you found anything else?
Post a comment
Recent comments
Elijah Lapson
on Lotus Vista? at 02:03
Volker Weber
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 01:14
Samuel Orsenne
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 00:02
Martin Rosenberg
on Danke Bahn, geht doch at 23:56
Volker Weber
on Things I learned while signing up for Bluehouse at 19:59
Mathias Ziolo
on Ubuntu for the Asus Eee Netbooks at 17:33
Stuart Mcintyre
on Things I learned while signing up for Bluehouse at 15:58
Flemming Riis
on Bluehouse does not support my browser at 15:30
Thomas Radigewski
on Bluehouse does not support my browser at 15:26
Stuart Mcintyre
on Bluehouse does not support my browser at 15:25
Volker Weber
on Bluehouse does not support my browser at 15:03
Stuart Mcintyre
on Bluehouse does not support my browser at 14:59
Daniel Haferkorn
on Bluehouse does not support my browser at 14:51
Ben Poole
on Bluehouse does not support my browser at 14:43
Petite Abeille
on XING expands into UK and Ireland at 10:50
Stuart Mcintyre
on XING expands into UK and Ireland at 10:47
Stuart Mcintyre
on XING expands into UK and Ireland at 10:42
Volker Weber
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 09:52
Stephan H. Wissel
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 04:39
Henning Heinz
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 22:32
Volker Weber
on Things I learned while signing up for Bluehouse at 22:09
Frank van Rijt
on Ubuntu for the Asus Eee Netbooks at 21:57
Jef Reynders
on Things I learned while signing up for Bluehouse at 21:56
Volker Weber
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 21:03
Yves Luther
on GoDaddy.com Launches New Hosted Microsoft Exchange Plans at 21:00
Click here to subscribe
