and whats up with all these bots???

Other talk that doesn't fit elsewhere.
This is for General Discussion, not General chat.
User avatar
lav_coyote25
Professional
Professional
Posts: 3434
Joined: 08 Aug 2006, 23:18

and whats up with all these bots???

Post by lav_coyote25 » 31 Jan 2012, 09:12

is there a reason for all these unwarranted bots? :annoyed:
Registered users: Baidubot, Bingbot, Googlebot,, Magpiebot, MJ12bot, ,, Yandexbot
i have removed the what appears as humans from the list: ie: myself and safetyoff.
Attachments
bots on line.jpg

User avatar
lav_coyote25
Professional
Professional
Posts: 3434
Joined: 08 Aug 2006, 23:18

Re: and whats up with all these bots???

Post by lav_coyote25 » 31 Jan 2012, 09:19

and here again...

Registered users: , Baidubot,, Googlebot, , , Sougoubot
Attachments
bots on line2.jpg

User avatar
JDW
Regular
Regular
Posts: 1669
Joined: 18 May 2010, 20:44

Re: and whats up with all these bots???

Post by JDW » 31 Jan 2012, 09:27

They are all web crawlers , a.k.a spider bots. Pretty harmless. Used by search engines like google to index websites to improve searh results
:arrow: http://en.wikipedia.org/wiki/Web_crawler

Unless Eggplant's AI bots are taking over the world :wink:
"Speak when you are angry and you will make the best speech you will ever regret."
-- Ambrose Bierce

User avatar
Berg
Regular
Regular
Posts: 2202
Joined: 02 Sep 2007, 23:25
Location: Australia

Re: and whats up with all these bots???

Post by Berg » 31 Jan 2012, 09:30

Everyone wants to spy on every tiny bit of info on the net I think some of the bots are useful but a good many do not serve a useful purpose to wz2100 It is a drain on the system and annoying when they start posting useless links if allowed

Your the moderator slain the beasts

User avatar
lav_coyote25
Professional
Professional
Posts: 3434
Joined: 08 Aug 2006, 23:18

Re: and whats up with all these bots???

Post by lav_coyote25 » 31 Jan 2012, 09:33

Berg wrote:Everyone wants to spy on every tiny bit of info on the net I think some of the bots are useful but a good many do not serve a useful purpose to wz2100 It is a drain on the system and annoying when they start posting useless links if allowed

Your the moderator slain the beasts
if i was to do that, the hue and cry would be deafening. we have to put it up for a vote don't you know. :)

i understand some bots, that i recognize, but most of these are not.
Attachments
bots on line3.jpg

User avatar
Berg
Regular
Regular
Posts: 2202
Joined: 02 Sep 2007, 23:25
Location: Australia

Re: and whats up with all these bots???

Post by Berg » 31 Jan 2012, 09:36

I dont normaly vote when there is a poll about these things cause the bots will find out what your thinking and work up a profile on you...all very under cover and all ...just ban them from the forum then we can have a vote

User avatar
lav_coyote25
Professional
Professional
Posts: 3434
Joined: 08 Aug 2006, 23:18

Re: and whats up with all these bots???

Post by lav_coyote25 » 31 Jan 2012, 09:40

Berg wrote:I dont normaly vote when there is a poll about these things cause the bots will find out what your thinking and work up a profile on you...all very under cover and all ...just ban them from the forum then we can have a vote
DiiD, diid. so , there it is.
Attachments
bots on line4.jpg

User avatar
Berg
Regular
Regular
Posts: 2202
Joined: 02 Sep 2007, 23:25
Location: Australia

Re: and whats up with all these bots???

Post by Berg » 31 Jan 2012, 09:49

to be honest some are used for good but some are used for evil and I think

Users browsing this forum: Googlebot and 0 guests


that bot is following me

User avatar
effigy
Regular
Regular
Posts: 1217
Joined: 22 Jan 2010, 03:21
Contact:

Re: and whats up with all these bots???

Post by effigy » 31 Jan 2012, 14:33

Berg wrote:to be honest some are used for good but some are used for evil and I think

Users browsing this forum: Googlebot and 0 guests


that bot is following me
Have you tried crossing a river to lose it's scent?
This is why some features aren't implemented: http://forums.wz2100.net/viewtopic.php?f=30&t=7490&view=unread#p87241

cybersphinx
Inactive
Inactive
Posts: 1691
Joined: 01 Sep 2006, 19:17

Re: and whats up with all these bots???

Post by cybersphinx » 31 Jan 2012, 16:57

They have been there always, they just got names now and don't hide between the guests. Are you more uncomfortable now knowing that they're there? Also they're very sneaky, they don't produce any noticeable server load.
We want information... information... information.

User avatar
aubergine
Professional
Professional
Posts: 3459
Joined: 10 Oct 2010, 00:58
Contact:

Re: and whats up with all these bots???

Post by aubergine » 31 Jan 2012, 23:21

bingbot crashed my company website last week - it doesn't limit the number of open connections it makes to a site. We ended up adding it to robots.txt in the end to block it from our site.
"Dedicated to discovering Warzone artefacts, and sharing them freely for the benefit of the community."
-- https://warzone.atlassian.net/wiki/display/GO

User avatar
lav_coyote25
Professional
Professional
Posts: 3434
Joined: 08 Aug 2006, 23:18

Re: and whats up with all these bots???

Post by lav_coyote25 » 31 Jan 2012, 23:25

still hasn't answered the first question. why are they here in the first place? i understand one or two are needed... but that does not explain what the rest are doing. :annoyed:


User avatar
Emdek
Regular
Regular
Posts: 1329
Joined: 24 Jan 2010, 13:14
Location: Poland
Contact:

Re: and whats up with all these bots???

Post by Emdek » 01 Feb 2012, 18:55

They want information, they don't share crawling results (however at least Google sells own results for other companies), except of those who "steal" information from others (quite easy to do...), so they all generate traffic.

And yes, horribly written bots are usually just like DDoS attempt. ;-)
Nadszedł już czas, najwyższy czas, nienawiść zniszczyć w sobie.
The time has come, the high time, to destroy hatred in oneself.


Beware! Mad Qt Evangelist.

ambershark
New user
Posts: 1
Joined: 08 Feb 2012, 01:36

Re: and whats up with all these bots???

Post by ambershark » 08 Feb 2012, 01:52

They have left forever!


*15 seconds later on General discussion:Nyan Cat - by: Googlebot

:lol2:

Post Reply