Home > Alagad > MSN bot was smashing Trac server, here is how I blocked it

MSN bot was smashing Trac server, here is how I blocked it

September 21st, 2009

Just wanted to put a quick post out there.  I host about 50 trac environments on an EC2 server, several rather large ones of which are public and pretty high traffic.  Yesterday the trac server started having issues, and most of the logged errors had a seemingly random type of python trace data, followed by:
IOError: failed to write data
I dug around online for a bit but did not see much in the way of help for this issue, then I noticed that nearly all the errors were showing from a client that started with 65.55.X.X.  Flipping through other logs, it appeared to be an MSN bot agent hitting Trac pages, and in some cases even hitting an infinite recursion (somehow linking to /report2/report2/report2/report2/……). The quick and dirty fix to solve this issue was to block the entire subnet from accessing my vhosts, which was done with this little gem inside of each vhost <directory> tag in Apache:

 
Order Allow,Deny
Allow from all
Deny from 65.55.0.0/16

 
Granted this is not a perfect solution, but keeping the site up for real users was more important at the moment than allowing a rampant recursive spider to keep slamming the site as soon as I brought it back up (for nearly 2 days straight now).
Happy Friday!
 
 

Source:MSN bot was smashing Trac server, here is how I blocked it

admin Alagad

  1. October 21st, 2009 at 11:42 | #1

    Great. Now i can say thank you

  2. October 23rd, 2009 at 16:07 | #2

    Great. Now i can say thank yo

  3. October 24th, 2009 at 14:01 | #3

    Now i can say thank

  4. October 26th, 2009 at 15:00 | #4

    grace site.

  5. October 28th, 2009 at 07:23 | #5

    grace your site.

  6. October 29th, 2009 at 17:49 | #6

    very grace your site.

  7. October 30th, 2009 at 11:09 | #7

    grace site yaor. canadian on line pharmacyj

  8. October 31st, 2009 at 09:50 | #8

    grace site yaor two.

  9. November 1st, 2009 at 10:13 | #9

    hi. I review you site

  10. November 30th, 2009 at 17:34 | #10

    I want to say - thank you for this!

  11. November 30th, 2009 at 18:07 | #11

    Great site. Keep doing.

  12. November 30th, 2009 at 18:24 | #12

    Very interesting site. Hope it will always be alive!

  13. November 30th, 2009 at 18:41 | #13

    Perfect work!

  14. November 30th, 2009 at 18:56 | #14

    Excellent site. It was pleasant to me.

  15. November 30th, 2009 at 19:12 | #15

    I bookmarked this link. Thank you for good job!

  16. November 30th, 2009 at 19:28 | #16

    If you have to do it, you might as well do it right.

  17. November 30th, 2009 at 19:44 | #17

    Great. Now i can say thank you!

  18. November 30th, 2009 at 20:01 | #18

    Very cute :-))))

  19. November 30th, 2009 at 20:17 | #19

    It is the coolest site, keep so!

  20. November 30th, 2009 at 20:32 | #20

    Great work,webmaster,nice design!

  21. November 30th, 2009 at 20:48 | #21

    I want to say - thank you for this!

  22. November 30th, 2009 at 21:04 | #22

    Great site. Keep doing.

  23. November 30th, 2009 at 21:19 | #23

    Very interesting site. Hope it will always be alive!

  24. November 30th, 2009 at 21:35 | #24

    Perfect work!

  25. November 30th, 2009 at 21:51 | #25

    Excellent site. It was pleasant to me.

  26. November 30th, 2009 at 22:07 | #26

    I bookmarked this link. Thank you for good job!

  27. November 30th, 2009 at 22:22 | #27

    If you have to do it, you might as well do it right.

  28. November 30th, 2009 at 22:38 | #28

    Great. Now i can say thank you!

  29. November 30th, 2009 at 22:53 | #29

    Very cute :-))))

  30. November 30th, 2009 at 23:08 | #30

    It is the coolest site, keep so!

  31. November 30th, 2009 at 23:24 | #31

    Great work,webmaster,nice design!

  32. November 30th, 2009 at 23:39 | #32

    I want to say - thank you for this!

  33. November 30th, 2009 at 23:54 | #33

    Great site. Keep doing.

  34. December 1st, 2009 at 00:09 | #34

    Very interesting site. Hope it will always be alive!

  35. December 1st, 2009 at 00:24 | #35

    Perfect work!

  36. December 1st, 2009 at 00:41 | #36

    Excellent site. It was pleasant to me.

  37. December 1st, 2009 at 00:56 | #37

    I bookmarked this link. Thank you for good job!

Comment pages
  1. No trackbacks yet.