Plusnet
Sunday 22nd November 2009Login | Register | Help
Pages: [1]

Website timeouts

« on 04/11/2009, 13:03 »
I have a sub-domain at art.concepts.org.uk which is a free online art portfolio for people to promote their artistic skill, recently I noticed I was getting a lot of traffic sent to me from spammy sites for cigarettes and herbal viagra. When I visited the pages that were sending me the traffic, I couldn't find my link, so I reckon it was something dodgy and banned the websites IP addresses. Since then my site has started to receive higher than normal timeouts (its now about a couple of times per day rather than 1 or 2 per fortnight). So I am just wondering if my site is under some form of attack from these malicious sites, and if so, can anyone point me to any online articles for securing my site against these attacks?
Logged
« Reply #1 on 04/11/2009, 17:28 »
How exactly have you 'banned the IP address'? Whilst it's geared towards our Homepages/CGI platforms, this might be of some interest.
Bob Pullen
Plusnet Comms Team
Service Status :: RSS :: Email

twitter / plusnet
Logged
« Reply #2 on 04/11/2009, 20:26 »
I should have mentioned that its externally hosted (not on PlusNet servers), apologies.

The IP addresses have been banned via cPanel which is installed on the server. Thanks for the link, looking at the info, I reckon I'll need to create a robots.txt for the site, and see how that goes as there is a high number of unknown robots crawling the site on a daily basis.  Thanks again, hopefully this will help Smiley
Logged
« Reply #3 on 05/11/2009, 23:41 »
I've now written a robots.txt for my site, but whilst researching info on this, I did find that bad bots usually ignore the robots.txt, however I have found a workaround:

Quote
Add a line like this to your robots.txt file:

Disallow: /email-addresses/

where 'email-addresses' is not a real directory. Wait a decent amount of time (a week to a month) then go through your access_log file and pick out the User-Agent strings that accessed the /email-addresses/ directory. These are the worst of the worst - those that blatantly disregard our attempts to keep them out

The full article can be seen at: http://www.evolt.org/arti...stop_bad_robots/18/15126/
Logged
Pages: [1]
Jump to:  

Related Sites

Community Apps

Here at Plusnet we're always trying to use clever open source things to make our lives easier. Sometimes we write our own and make other people's lives easier too!

View the Plusnet Open Source applications page

About Plusnet

We sell broadband, phone, VoIP and more to homes and businesses in the UK. Winner of 9 out of 11 Categories in the 2008 USwitch survey. Winner of "Best Consumer ISP" at 2008 ISPA awards. Voted number 1 in the Broadband Choices 2008 survey.

© Plusnet plc All Rights Reserved. E&OE

Powered by SMF | SMF © 2006-2008, Simple Machines LLC

Add to Technorati Favourites