|
- Readme First! -
Read and follow the rules, otherwise your posts will be closed |
|
|
|
|
|
There are currently, 244 guest(s) and 0 member(s) that are online.
You are Anonymous user. You can register for free by clicking here |
|
|
|
|
|
Site: Full listing of negatively impacting mail/web miners |
|
 Compiling lists from various robots.txt files on the net from sources like SearchEngineWorld.com/robots.txt and sites like www.sendfakemail.com/fakemail/antispam.html, we have established code to save our servers bandwidth and to help further protect our users privacy from data miners searching for email addresses or just simply stealing our bandwidth by downloading all our pages.
Below is a listing of the user-agents that such data miners use.
Alexibot
asterias
BackDoorBot
Black.Hole
BlowFish
BotALot
BuiltBotTough
Bullseye
BunnySlippers
Cegbfeieh
CheeseBot
CherryPicker
CopyRightCheck
cosmos
Crescent
DittoSpyder
EmailCollector
EmailSiphon
EmailWolf
EroCrawler
ExtractorPro
Foobot
Harvest
hloader
httplib
humanlinks
ia_archiver
InfoNaviRobot
JennyBot
Kenjin.Spider
Keyword.Density
LexiBot
libWeb/clsHTTP
LinkextractorPro
LinkScan/8.1a.Unix
LinkWalker
lwp-trivial
Mata.Hari
Microsoft.URL
MIIxpc
Mister.PiX
moget
Mozilla/3.Mozilla/2.01
Mozilla.*NEWT
NetAnts
NetMechanic
NICErsPRO
NPBot
Offline.Explorer
Openfind
ProPowerBot/2.14
ProWebWalker
QueryN.Metasearch
RepoMonkey
RMA
SiteSnagger
SpankBot
spanner
suzuran
Szukacz/1.4
Teleport
Telesoft
The.Intraformant
TheNomad
TightTwatBot
Titan
toCrawl/UrlDispatcher
True_Robot
turingos
URLy.Warning
VCI
WebAuto
WebBandit
WebCopier
WebEMailExtrac.*
WebEnhancer
Web.Image.Collector
WebmasterWorldForumBot
WebSauger
Website.Quester
Webster.Pro
WebStripper
WebZip
[Ww]eb[Bb]andit
WWW-Collector-E
Xenu's
Zeus
|
|
Posted on Tuesday, February 11 @ 00:57:35 CET by Zhen-Xjell |
|
|
|
|
| |
|
Average Score: 5
Votes: 1
|
|
|
|
|
|
|
| | The comments are owned by the poster. We aren't responsible for their content. |
| | | | |
| No Comments Allowed for Anonymous, please register | | | | |
Re: Full listing of negatively impacting mail/web miners (Score: 1)
by Zhen-Xjell on Tuesday, February 11 @ 01:20:50 CET
(User Info | Send a Message) http://castlecops.com | On top of that I have noticed that the following IP addresses from the past couple hours aren't sending any user-agent whatsoever. Too bad for them.
192.54.193.10 "-"
195.224.39.102 "-"
207.44.158.24 "-"
209.120.145.34 "-"
212.68.224.129 "-"
213.28.148.2 "-"
24.118.73.91 "-"
62.24.229.1 "-"
63.237.214.22 "-"
64.21.32.2 "-"
|
- Re: by Anonymous on Tuesday, February 11 @ 09:19:38 CET
| | | | |
|
