Innerworld@lemmy.world to Data is Beautiful@lemmy.worldEnglish · 3 months agoEstimated share of global web traffic generated by humans and bots (2018-2025)cdn.statcdn.comimagemessage-square10linkfedilinkarrow-up145arrow-down10
arrow-up145arrow-down1imageEstimated share of global web traffic generated by humans and bots (2018-2025)cdn.statcdn.comInnerworld@lemmy.world to Data is Beautiful@lemmy.worldEnglish · 3 months agomessage-square10linkfedilink
minus-squareSixseven@sh.itjust.workslinkfedilinkEnglisharrow-up2·3 months agoWhat are examples of benign bots?
minus-squareArmok_the_bunny@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoGoogle’s search indexer.
minus-squareIphtashuFitz@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoI’d consider search engine bots from the likes of Google, Microsoft, etc. to be benign. They provide a useful service to websites and honor robots.txt directives. Bots that impersonate Google etc. and/or ignore robots.txt are considered bad bots.
What are examples of benign bots?
Google’s search indexer.
I’d consider search engine bots from the likes of Google, Microsoft, etc. to be benign. They provide a useful service to websites and honor robots.txt directives.
Bots that impersonate Google etc. and/or ignore robots.txt are considered bad bots.