Please flush these bots off the forum.

Discuss new features and functions
JDB
Posts: 45
Joined: 15 Feb 2018

Post by JDB

Please disallow bots to be members of the forum. They are not going to contribute anything and they will scavenge our souls:

Registered users: Bing [Bot], Dot [Bot], Google [Bot], Semrush [Bot], Subere, Yandex [Bot]

Every time I login there is a different list of dastardly bots logged in. Why?

It makes me wonder if there is hidden spyware in the software itself.

-JDB
sflorg
Posts: 11
Joined: 19 Jun 2020

Post by sflorg

Better question. . .why so paranoid?
They're just search engine crawlers, and very helpful when searching for a topic.
They are not crawling all over you. You aren't getting bugs.
JDB
Posts: 45
Joined: 15 Feb 2018

Post by JDB

You could be right; perhaps I am paranoid. However many of these alleged search engine crawlers are spoofed because all they have to do is create fake USER_AGENT and REFERRER server variables to get past basic security measures. Many ignore robots.txt. Recently, bots pretending to be Baidu and Yandex, ignoring robots.txt, completely downloaded every single photo on a website I manage. It didn't look like normal indexing because ever access was milliseconds apart with HTTP Code 200 and transfer of the entire file. They have no business creating a web cache of my data in another country. I have since blocked them. Other bots pretending to be Google issue thousands of stupid requests for porn even though there is none to be found. They don't stick to the business they are tasked to perform; I think many hire "curious" employees working for them who violate security etiquette under the covers, and kiddie-scripting during their lunch hour is fun for them. It's one thing if they legitimately index forum questions and answers, but they are also after our names and whatever personal information shows up in our profiles. They match our data against other sites, and if our email address appears in anything they dig up, we will be spammed. If we supply actual recognizable photos for the avatar thumbnails, they will be fed to the monstrous facial recognition system powered by one of the largest supercomputers in the world managed by Huawei. It won't be long before every Huawai and Oppo cell phone will be able to point at any random person's face and tell you who it is.
User avatar
Plerry
Posts: 1027
Joined: 22 Aug 2012

Post by Plerry

Conversely, I suppose you still like (legitimate) search engines to be able to point you to relevant web-resources; if applicable also to discussions in this forum.
JDB
Posts: 45
Joined: 15 Feb 2018

Post by JDB

Yes, Plerry, if only it were possible to differentiate the legitimate ones from the bogus impostors or those that have been compromised by ill motives. One cannot trust Google after finding out that Google Plus was a wicked back door that only the elite few knew how to open. I think that was intentional! They deserve the 7.5 Million Dollar lawsuit against them for that! Who can trust Bing? Who says that Microsoft is reputable? And even, who can trust DuckDuckGo that DEPENDS UPON BING?

I wish that search engines would operate the way they did back in the 90's and not constantly struggle to squeeze some stupid money making scheme out of the data that they acquire. A mere $1.00 per month from every user is all it would take to end this crapnosense.

Long live Lycos; Long live Alta Vista. Good by forever, old friends.

I know... I'm an old fart... I am not hep to the jive as we used to say in the 50's.