| View previous topic :: View next topic |
| Author |
Topic : "Where has Craig Mullins gone???" |
tmcguire
junior member
Member #
Joined: 22 Feb 2006
Posts: 2
|
 Posted: Wed Feb 22, 2006 3:24 pm |
 |
 |
Ok..i'm going to chime in. This is a bit of a knee-jerk post so sorry if the continuity seems a little broken.
My name is Tom. I own operate a small hosting company called NeverLAN which focuses on hosting art related content. We happily and greatfully host goodbrush.com
To the point:
One of the things we do to help maintain reasonable speeds and oh yes...low prices...(we don't limit bandwidth consumption) for hosting on the sites that we host is to monitor the server activity. Way more often than you'd expect we see offline readers bots and scrapers just raking content from our users sites. I'd say 50/50 between the U.S. and other countries.
Scrapers are BAD when used improperly. It is possible to have the bot 'take naps' between requests which doesn't bother web servers that much.
I've removed ALL of the blocked IP address from the database so you all can browse away.
But please don't us bot's to save the sites or your IP may get listed again back into the block list by one of our staff.
Sadly blocking IP's is the only way we can stop the scrapers from destroying the bandwidth.
Here is some sample log data from some user from sweden that is using a bot this second. You'll notice the the hit's are coming about 3ish per second.
| Code: |
c213-200-142-XXX.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:29 -0800] "HEAD /cm/index.php?cat=6 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-XXX.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:29 -0800] "HEAD /cm/thumbnails.php?album=20&page=1 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:29 -0800] "HEAD /cm/login.php?referer=%2Fcm%2Fdisplayimage.php%3Falbum%3D21%26pos%3D0 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:30 -0800] "HEAD /cm/thumbnails.php?album=favpics HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:30 -0800] "HEAD /cm/profile.php?uid=1 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:30 -0800] "HEAD /cm/thumbnails.php?album=lastcom&cat=-20 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:31 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=0 HTTP/1.1" 302 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:31 -0800] "HEAD /cm/thumbnails.php?album=lastup&cat=-20 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:32 -0800] "HEAD /cm/displayimage.php?pos=-1134 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:32 -0800] "HEAD /cm/thumbnails.php?album=topn&cat=-20 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:32 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=1 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:33 -0800] "HEAD /cm/thumbnails.php?album=toprated&cat=-20 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:33 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=2 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:34 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=3 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:34 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=4 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:34 -0800] "GET /cm/displayimage.php?album=20&pos=1 HTTP/1.1" 200 49116 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
c213-200-142-xxx.cm-upc.chello.se www.goodbrush.com - - [22/Feb/2006:15:11:35 -0800] "HEAD /cm/ratepic.php?pic=1134&rate=5 HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 (KHTML, like Gecko) Safari/125.7"
|
That's a little messy to read and probably too techie for most.
I'll persoally work more closely with Craig to find a fool-proof solution that won't impact his presense.
I'm happy to answer any questions or reply to any comments any of you may have.
-Regards
Tom McGuire
Neverlan Helpdesk
_________________
Neverlan.net and some other stuff too.
Last edited by tmcguire on Thu Feb 23, 2006 10:02 am; edited 1 time in total |
|
| Back to top |
|
oDD
member
Member #
Joined: 07 May 2002
Posts: 1000
Location: Wroclaw Poland
|
| Posted: Thu Feb 23, 2006 9:53 am |
|
|
nope still doesnt work for me. hmmm maybe i should move to sweden.
_________________
portfolio | art blog |
|
| Back to top |
|
Drunken Monkey
member
Member #
Joined: 08 Feb 2000
Posts: 1016
Location: mothership
|
| Posted: Tue Feb 28, 2006 2:06 am |
|
|
tmcguire, thanks for the post.
it would be great if you guys could provide a big .zip of it all... which is updated along with goodbrush.
just mho.
_________________
"A fear of weapons is a sign of retarded sexual and emotional maturity" - Sigmund Freud |
|
| Back to top |
|
tmcguire
junior member
Member #
Joined: 22 Feb 2006
Posts: 2
|
| Posted: Tue Feb 28, 2006 9:52 am |
|
|
That is a fantastic idea, however, that is up tor Craig. Sadly we can't just to zipping up our clients websites and start offering them for download.
I'm sure you understand.
-Tom
_________________
Neverlan.net and some other stuff too. |
|
| Back to top |
|
Drunken Monkey
member
Member #
Joined: 08 Feb 2000
Posts: 1016
Location: mothership
|
| Posted: Tue Feb 28, 2006 10:59 pm |
|
|
bring it up to him.. 
_________________
"A fear of weapons is a sign of retarded sexual and emotional maturity" - Sigmund Freud |
|
| Back to top |
|
mate0
junior member
Member #
Joined: 25 Mar 2006
Posts: 2
|
| Posted: Sun Apr 09, 2006 12:02 pm |
|
|
| I also couldn't browse goodbrush, that's why i would like to share with my discovery. The easiest way of changing ip is to use proxy, so just experiment (like i did) and you'll be able to admire one of the greatest masterpieces. |
|
| Back to top |
|
|
