New study finds bots and fraud farms responsible for 73% of web traffic (interestingengineering.com)
from L4s@lemmy.world to technology@lemmy.world on 03 Dec 2023 08:00
https://lemmy.world/post/9077917

New study finds bots and fraud farms responsible for 73% of web traffic::undefined

#technology

threaded - newest

[deleted] on 03 Dec 2023 08:08 next collapse

.

leekleak@lemmy.world on 03 Dec 2023 08:16 next collapse

Oh no! Poor people!

WhiteOakBayou@lemmy.world on 03 Dec 2023 08:30 next collapse

None of the Indians I’ve met are bots

[deleted] on 03 Dec 2023 08:47 collapse

.

Vlyn@lemmy.zip on 03 Dec 2023 09:38 collapse

Most bot generated content is from things like ChatGPT, so are you going to be mad at people in San Francisco now?

tpd6@futurology.today on 03 Dec 2023 09:50 next collapse

I’m talking about times before the ai meme was taken on by the masses

Tattorack@lemmy.world on 03 Dec 2023 10:26 collapse

Hmm… If it wasn’t for Starfleet Headquarters being there I’d say yes.

FlyingSquid@lemmy.world on 03 Dec 2023 11:54 collapse

Just one year until the Bell Riots.

ZeroCool@feddit.ch on 03 Dec 2023 08:39 next collapse

Bravely said on a throwaway. 🙄

tpd6@futurology.today on 03 Dec 2023 08:47 collapse

Good morning sir

3TH4Li4@feddit.ch on 03 Dec 2023 14:05 collapse

Jokes on you majority of internet users are not from India, but from English speaking countries. Any other language takes a smaller percentage.

arandomthought@sh.itjust.works on 03 Dec 2023 08:21 next collapse

Holy shit, thinking of all the resources that are just wasted for this shit… Imagine you could just slash all web infrastructures by two thirds.

JDubbleu@programming.dev on 03 Dec 2023 08:39 next collapse

I really hate the phrase “bots” because it gives the appearance that they’re all useless and malicious. I guarantee you they lumped in the following extremely valid uses of “bots”:

  • Automated personal scripts that many programmers use, these are technically bots. Hell, I use a “bot” to auto-clip digital Safeway coupons
  • Moderation bots on sites like Lemmy/Reddit
  • Archive efforts

Are AI chatbots bots? If they use a loose enough definition all this means is humans utilize fuck tons of automation over the Internet, both programmers and not.

Riccosuave@lemmy.world on 03 Dec 2023 09:34 next collapse

I use a “bot” to auto-clip digital Safeway coupons

How?

Decoy321@lemmy.world on 03 Dec 2023 10:07 next collapse

They go, “hey bot, would you please clip me some Safeway coupons?”

Then the bot goes and gets their little bot scissors and their bot newspaper, then clips up some coupons and hands them to OP.

It’s a pretty endearing sight.

Tattorack@lemmy.world on 03 Dec 2023 10:25 next collapse

“Father, what is my purpose?”

“You clip coupons.”

“… Oh my god…”

FlyingSquid@lemmy.world on 03 Dec 2023 11:53 collapse

Then the bot goes and gets their little bot scissors

But digitally.

and their bot newspaper,

But digitally.

then clips up some coupons

But digitally.

and hands them to OP.

But digitally.

They said we’d all be living in a VR world by now back in the 90s!

Viking_Hippie@lemmy.world on 03 Dec 2023 13:16 collapse

I had some good times with your mom last night. But digitally.

JDubbleu@programming.dev on 03 Dec 2023 17:15 collapse

TamperMonkey (I’ve been told to use ViolentMonkey instead as TamperMonkey isn’t open source) and the script here. Then you can run a script to periodically log into your account in a headless browser and click the button. Unfortunately there’s no coupon API so this is the best solution I could think of.

Riccosuave@lemmy.world on 03 Dec 2023 17:26 collapse

Thank you for giving the first real answer. As funny as the others were, I was in fact looking for a legitimate understanding of how to do this 🙃

Eheran@lemmy.world on 03 Dec 2023 11:52 next collapse

Why do you think that such bots cause a relevant amount of traffic?

JDubbleu@programming.dev on 03 Dec 2023 17:10 collapse

Because they’re used absolutely everywhere, and often back large portions of Internet infrastructure. I’m a backend developer and we have thousands of “bots” running at any given time to keep our systems going. They generate traffic equivalent to thousands of people and are maintained by a 3 person dev team. This is for a relatively small company. When I was at AWS the scale was much more unfathomable.

Touching_Grass@lemmy.world on 03 Dec 2023 13:04 next collapse

Tech journalism is fucking garbage. Its always trying to tell me what to think rather than present legit unbiased information. It seems to get worse every year as if these journalist have a hate on for the tech they write about

jaybone@lemmy.world on 03 Dec 2023 18:58 next collapse

I use a bot to convert source code into executable binaries.

arandomthought@sh.itjust.works on 03 Dec 2023 19:59 collapse

That’s a very good point, thanks!

fmstrat@lemmy.nowsci.com on 03 Dec 2023 13:45 collapse

Not really, as with many others the headline is sensationalist. It’s missing the “… on login page attempts for sites that pay for and or use bot protection services.”

arandomthought@sh.itjust.works on 03 Dec 2023 19:58 collapse

That’s very good to know and makes the situation a lot less bleak. Thank you for the additional context!

fmstrat@lemmy.nowsci.com on 04 Dec 2023 16:36 collapse

NP, this article was also posted by a bot, so… You know.

auf@lemmy.ml on 03 Dec 2023 08:21 next collapse

The fact that this post is by a bot makes it sound so ironic

designatedhacker@lemm.ee on 03 Dec 2023 13:22 collapse

The headline stat is a misinterpretation of the study which was done by Arkose Labs which “provides businesses with lasting bot prevention and account security by sapping the financial motivations of cybercriminals.”

That’s pretty vague but skimming it sounds like they prevent automated account creation and takeover. The stat comes from the companies they have access to (who need bot protection enough to pay for it), and 76% of activity on the login/account creation was malicious. That makes a lot more sense. All the various hacks and credential leaks result in bots banging in stolen credentials on high value sites.

jdeath@lemm.ee on 03 Dec 2023 14:32 next collapse

Arkose does log-in protection for Roblox (and others but that’s the one I’m familiar with) where the user has to do something like rotate a picture before logging in.

CosmicCleric@lemmy.world on 03 Dec 2023 19:19 collapse

The headline stat is a misinterpretation of the study

and 76% of activity on the login/account creation was malicious.

Are you assuming though that that’s 76%, once they’ve created an account, would do no fuether interaction with the Internet after that?

I’m not sure of the point that you’re trying to make?

Syrc@lemmy.world on 04 Dec 2023 01:48 next collapse

Well, I mean, if a bot protection company found malicious activity in account creation, I’m assuming they stopped the account from completing it…?

CosmicCleric@lemmy.world on 04 Dec 2023 20:03 collapse

I’m assuming they stopped the account from completing it…?

They could have let it continue to monitor it, in a honey-pot sort of way, to learn more about the bot, and it’s network.

But I was asking towards intent, not success. Why would people have bots create accounts and then do absolutely nothing with those accounts afterwards?

Syrc@lemmy.world on 05 Dec 2023 01:59 collapse

I mean, that commenter said the headline was a misinterpretation because it’s not 73% of web traffic, but only account creation attempts.

If the attempts are stopped, and the bot fails in creating an account, it isn’t able to post/comment/do whatever it needed to do, and isn’t contributing to “web traffic” as much as the other 27% of real people (or, well, uncaught bots).

designatedhacker@lemm.ee on 04 Dec 2023 02:23 collapse

You think these bots are streaming movies and music? 73% of Internet traffic is not bots. It’s all YouTube, Netflix, Insta, TikTok, Spotify, etc media consumption. 73% of login traffic may be bots, but it’s a teeny drop of global traffic.

CosmicCleric@lemmy.world on 04 Dec 2023 20:00 collapse

73% of login traffic may be bots, but it’s a teeny drop of global traffic.

So you are assuming they’re just logging in and not doing anything else, yes?

That there are no bots that (for example) watch YouTube videos and then gives them a like up or down, depending how they’ve been paid to do so, etc?

Synthead@lemmy.world on 03 Dec 2023 08:45 next collapse

!veryrealtechpics@lemmy.world

Nacktmull@lemm.ee on 03 Dec 2023 10:44 next collapse

And I thought porn and cat pictures where responsible for 70% of web traffic… TIL

geogle@lemmy.world on 03 Dec 2023 11:15 next collapse

This is just what the bots are into.

Thetimefarm@lemm.ee on 03 Dec 2023 15:45 collapse

It’s why AI porn is so popular all of a sudden, all the bots thought human porn was weird.

Alchemy@lemmy.world on 03 Dec 2023 15:29 collapse

70% of my web traffic, anyways.

thelastknowngod@lemm.ee on 03 Dec 2023 11:03 next collapse

Wonder what the engineering solution to this could look like…

Thinking something like a zero trust model being required for all web requests… Like the target address would need to receive a validated identity token from some third party but that token couldn’t contain identifying info about the requester. Likewise, the validating third party would need to verify the identity of the requester without having knowledge of the target address.

Then that raises more questions like who would we all be comfortable trusting as a verifier and what data would we use for that validation? The validation system and the data used to validate would need to be provided for free too to account for low income people so no subscription services or hardware MFA keys. Also who counts as an identity to be validated?

What do enforcement mechanisms look like if this does get built? Are the validators entirely passive or do they actively participate in the process? Like do we have rate limits imposed by the validation engine or do we just leave that to the target address/organization to impose themselves? What happens if someone is banned from a site? Does the site notify the validators to drop requests earlier in the lifetime of a request? Do individuals get a lower request quota than corporations? Would you have to form a company just to prototype a new tool/product?

If someone seriously wanted to work on this I’d jump on the opportunity to work with them. It sounds like a fascinating project.

Rodeo@lemmy.ca on 03 Dec 2023 12:19 collapse

It’s called Google’s “Web Integrity API” and it’s a horrifically bad idea.

JeffKerman1999@sopuli.xyz on 03 Dec 2023 12:20 next collapse

Yeah dead internet. And I hope this news will kill online marketing for good

3TH4Li4@feddit.ch on 03 Dec 2023 14:02 collapse

As long as real users exist on the internet, marketing will follow. If centralized social media will be even more of a shithole than already is, then they will slowly target the decentralized. You won’t escape marketing.

CaptainSpaceman@lemmy.world on 03 Dec 2023 15:15 next collapse

But if 73% of traffic is fake, and they monitor traffic to determine sentiment and marketing strategies, then who are they actually marketing TO?

CosmicCleric@lemmy.world on 03 Dec 2023 19:14 collapse

Those left over who are still human.

But you do bring up a great point, what happens when the Internet is nothing but bots/shills?

JeffKerman1999@sopuli.xyz on 03 Dec 2023 18:16 collapse

Man they caught Google evil actors using Google’s infra that pumped up view numbers for video impressions and milking advertisers.

They got swindled millions by the 3ve “scandal”.

There’s botfarms clicking ads and following brands.

There’s warehouses full of smartphones that fake download and fake use apps and fake watch video ads…

At this point it’s a money laundering scheme. I refuse to believe that those people responsible are that stupid.

1984@lemmy.today on 03 Dec 2023 12:58 next collapse

The web is like a shitty neighborhood now, with stalkers and unpleasant people coming up to you frequently to sell their shady stuff.

Still works for finding answers to technical questions but if I wasn’t working in tech, I would probably question why im using it in the first place. Is the entertainment value worth the cost?

vaultdweller013@sh.itjust.works on 04 Dec 2023 03:04 collapse

Depends does hentai count as entertainment cayse if so. Yes.

Goldmage263@sh.itjust.works on 04 Dec 2023 07:24 collapse

Based. That and comics of culture.

Viking_Hippie@lemmy.world on 03 Dec 2023 13:14 next collapse

100% on Twitter, 150% on Facebook. Or maybe the other way around 🤷

shadowspirit@lemmy.world on 03 Dec 2023 15:21 next collapse

Was scrolling through Facebook as I still use it to keep in touch with family. 20 sponsored posts for every one actual post. Facebook is terrible.

OminousOrange@lemmy.ca on 03 Dec 2023 16:16 collapse

I just went on my annual visit. I’m not sure if it was ublock or what, but it was actually a fairly pleasant experience with no ‘sponsored’ content. Reminded me of the Facebook of old. Accessed through the browser, of course. I don’t want that cancerous app on my phone.

shadowspirit@lemmy.world on 04 Dec 2023 01:24 collapse

I am on mobile. I’ll try desktop!

OminousOrange@lemmy.ca on 04 Dec 2023 03:42 collapse

I was on mobile too, just on Firefox with ublock.

shadowspirit@lemmy.world on 04 Dec 2023 05:13 collapse

I caught that after I replied. Firefox with ublock is now my default android browser. You’re right…going into feed mode to see posts chronologically with ad block is the Facebook of old. Thanks for the tip.

dreamer@lemm.ee on 03 Dec 2023 15:35 collapse

How are you about to do that on Facebook? I can’t even sign up without it asking for my ID

sanguine_artichoke@midwest.social on 04 Dec 2023 17:43 collapse

I had an account for about 10 years which I never used at first, then a fair bit for 3-4 years, linked it to Instagram and WhatsApp. Then I didn’t sign into Facebook for 2-3 years and when I tried, despite having the same email and using the linked IG accounts, they demanded my drivers license. Uh, no way in hell I’ll ever do that, so guess I’m not signing into stupid Facebook. Not sure who the hell they think they are or why they believe I’d consider their awful website so important as to send them my ID.

CosmicCleric@lemmy.world on 04 Dec 2023 20:06 collapse

I didn’t sign into Facebook for 2-3 years and when I tried, despite having the same email and using the linked IG accounts, they demanded my drivers license. Uh, no way in hell I’ll ever do that, so guess I’m not signing into stupid Facebook.

Curious if you give Discord your phone number?

sanguine_artichoke@midwest.social on 04 Dec 2023 23:34 next collapse

I haven’t used discord but I’m sure I’ve supplied plenty of personally identifiable information to other companies.

dreamer@lemm.ee on 05 Dec 2023 04:46 collapse

I don’t but I am aware that it can be used to identify you, as well as from other people if they give open access to their contacts. They only have my email.

paddirn@lemmy.world on 03 Dec 2023 13:15 next collapse

More evidence for the Dead Internet Theory

3TH4Li4@feddit.ch on 03 Dec 2023 14:03 next collapse

Not yet but soon it will be

CosmicCleric@lemmy.world on 03 Dec 2023 19:10 collapse

Death by a thousand cuts bot/shill posts.

qooqie@lemmy.world on 04 Dec 2023 15:13 collapse

I don’t necessarily think it’s a bad thing if people were good, but it can easily be abused as we’ve seen with election manipulation.

sennheisenberg@lemmy.sdf.org on 03 Dec 2023 16:45 next collapse

“73% of web traffic” does not mean 73% of comments, posts, content, etc.

indepndnt@lemmy.world on 04 Dec 2023 05:55 collapse

It amazes me when I spin up some random server on a cloud provider and it’s immediately getting tons of traffic from bots searching for insecure ssh servers and default WordPress admin credentials and then like. If that’s the short of stuff they’re counting, I’d believe it. But yeah, it’s not like all the commenters on this post are bots.

Enigma28@lemmy.world on 04 Dec 2023 07:33 next collapse

Yeah we had a presentation at work from AWS , they said expect all ports and protocols on any aws server you spin up to be scanned in less than 1min of any instance being created

CosmicCleric@lemmy.world on 04 Dec 2023 19:58 collapse

But yeah, it’s not like all the commenters on this post are bots.

What percentage would you guess that are bots as commenters?

indepndnt@lemmy.world on 05 Dec 2023 03:15 collapse

That’s a good question, I doubt I could make a very accurate guess. Just broadly though, based mainly on the lack of an immediately obvious payoff, I’d guess less than 50%.

lolcatnip@reddthat.com on 03 Dec 2023 21:20 next collapse

So the same as snail mail and phone calls?

ThePrivacyPolicy@lemmy.ca on 04 Dec 2023 22:12 collapse

I recently switched cell providers to save a pile of money, but the new one doesn’t have call control like the old did. 100% of my calls over the last two weeks were spam calls. I keep telling myself the savings are worth it, but my God it’s annoying.

affiliate@lemmy.world on 03 Dec 2023 23:24 next collapse

i hate it when i open my laptop and there’s an error sign blocking the trackpad

grayman@lemmy.world on 04 Dec 2023 02:55 next collapse

Horse shit.

Sandvine still released traffic reports. So does Cable Labs.

Maybe attempted connections, but not volume / tonnage / bytes.

dag__@lemmy.world on 04 Dec 2023 07:38 collapse

Okay, bot. I believe it, doesn’t surprise me at all. Lemmy is also full of bots.

zzx@lemmy.world on 05 Dec 2023 04:58 collapse

I’m a bot

Newguy@lemmy.world on 04 Dec 2023 04:37 next collapse

Bot wars

RGB3x3@lemmy.world on 04 Dec 2023 15:25 next collapse

No I’m not!

Daxtron2@startrek.website on 05 Dec 2023 00:37 collapse

No I’m… Doesn’t…

banneryear1868@lemmy.world on 04 Dec 2023 16:55 next collapse

Soon there will be content created and consumed entirely by generative “ai,” an almost shadow-culture.

onlinepersona@programming.dev on 04 Dec 2023 17:29 collapse

They’ll have memes beyond our understanding!

banneryear1868@lemmy.world on 04 Dec 2023 17:37 collapse

Obligatory

PipedLinkBot@feddit.rocks on 04 Dec 2023 17:38 next collapse

Here is an alternative Piped link(s):

Obligatory

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I’m open-source; check me out at GitHub.

Katana314@lemmy.world on 05 Dec 2023 03:37 collapse

Thanks, guy who posts Piped links!

What worries me, though, is the idea of bots infiltrating the Fediverse…posting among us.

onlinepersona@programming.dev on 04 Dec 2023 18:51 collapse

Prophetic.

A_Random_Idiot@lemmy.world on 05 Dec 2023 03:47 next collapse

I miss the days when the internet was a fad that most people were apathetic towards.

before we even had search engines, and had to rely on websites listing links to every website.

AlecSadler@sh.itjust.works on 05 Dec 2023 06:38 collapse

banner exchange 😂

A_Random_Idiot@lemmy.world on 05 Dec 2023 06:41 collapse

Internet yellow pages and ring networks and word of mouth and slips of paper with weird urls written out on them.

AlecSadler@sh.itjust.works on 05 Dec 2023 07:09 collapse

1px midis with auto play.

A_Random_Idiot@lemmy.world on 05 Dec 2023 07:12 collapse

oh man… and frames. and tables.

Whens the last time you saw a classic html table?

AlecSadler@sh.itjust.works on 05 Dec 2023 07:45 next collapse

Well, I work in web dev as a career so unfortunately the answer to that is not long enough ago :/

uSpetzWon@lemmy.world on 05 Dec 2023 13:26 collapse

Last week when a “Senior Fullstack Developer” who has had “senior” in his title for more than 4 years used a table for layout.

DeathsEmbrace@lemmy.ml on 05 Dec 2023 16:49 collapse

How much of the internet is automated should be the real question.