Twisted PageGetter – block or not

I found a Bot identifying itself as Twisted PageGetter in the access log of my site. After I googled for it I found on Matt’s Blog that he suggests to block this Bot with an htaccess entry. This is working quite well, I tried it. But: I am using Spotplex as a counter and wondered [...]

read all » Twisted PageGetter – block or not

Twisted PageGetter ... This new bot hit us with no crawler or spider identification link in the user agent so we banned it. ... Related posts: Karthigai Deepam and Thrikartika. Twisted PageGetter – block or not. Kimkins diet... ...


(Search for more on: ‘Twisted PageGetter’)