The creepy AI-driven surveillance that may be infiltrating your workplace (www.businessinsider.com)
from throws_lemy@lemmy.nz to technology@lemmy.world on 23 Nov 2023 11:16
https://lemmy.nz/post/3674086

#technology

threaded - newest

autotldr@lemmings.world on 23 Nov 2023 11:20 next collapse

This is the best summary I could come up with:


That data is then used for a wide variety of applications, such as detecting when someone may be lying about insurance claims, helping diagnose depression, and tracking how students are responding to a teacher during online learning.

Gabi Zijderveld, the chief marketing officer of Smart Eye, an EAI company that claims its tech “understands, supports, and predicts human behavior,” said the firm had amassed vast amounts of emotion-based data by analyzing over 14.5 million videos of facial expressions it made with voluntary participants.

In these cases, paid participants watch online videos, and their facial expressions are analyzed by EAI technology to determine whether a joke in an ad was funny or whether a particular moment in a movie trailer elicited the emotional response it was meant to.

The idea behind the tech was noble: The EAI was supposed to mitigate bias and spot ideal candidates by identifying soft skills, cognitive ability, psychological traits, and emotional intelligence during video interviews.

In response to public outcry, the company said in 2021 it would stop the use of EAI facial analysis because it wasn’t worth the concern but would continue analyzing speech, intonation, and behavior during interviews.

Kat Roemmich, a Ph.D. student at the University of Michigan School of Information who has conducted research on EAI, has found that employees frequently remain unaware that their company is using the tech while they’re on the job.


The original article contains 2,089 words, the summary contains 232 words. Saved 89%. I’m a bot and I’m open source!

cheese_greater@lemmy.world on 23 Nov 2023 12:13 next collapse

I like how this looks like Bill Gates where there’s 'nother article of him extolling all these things he’s almost conceptually antithetical to

originalucifer@moist.catsweat.com on 23 Nov 2023 12:21 next collapse

may? its been here for awhile. they already have the data. your work machine is already being monitored for basic telemetry/metrics. they are just getting better at analysis and commoditization of tech so it can reach the masses (re:small business) cheaply.

BearOfaTime@lemm.ee on 23 Nov 2023 16:21 collapse

Yep.

I’ve been in enterprise IT for decades, with friends in SMB IT, and we often discuss the ongoing migration of enterprise grade stuff (hardware, software, processes, paradigms, etc) to the SMB space.

Some is good (like management/leadership, team building, etc. You know, the soft skills in this article). Other stuff can be problematic. Cloud-everything for example. Vendors (looking at you, MS), have painted SMB into a corner with licensing so cloud looks much more attractive.

What SMB management often ignores is now your business can be held hostage by your cloud provider, who, while they may claim your data is encrypted, are certainly surveilling everything that isn’t. When they decide to raise rates, or remove features, what are you going to do?

God, I’d love to create a competitor to Quickbooks in the OSS space.

bassomitron@lemmy.world on 23 Nov 2023 18:30 collapse

It’s off-topic for this thread, but as a fellow IT professional, the incessant push to cloud-ify everything is frustrating as hell. It’s like all concepts of “does this make sense for my use case?” no longer exist. Cloud is NOT always better, and I’d argue that in many instances, it is just plain worse than going with a local, on-prem solution.

BearOfaTime@lemm.ee on 23 Nov 2023 19:48 collapse

We’re very much on the same page. Seeing the SMB’s get sucked into cloud because on-prem has hardware costs is really frustrating. I blame bean-counter, because hardware is a capital expenditure and cloud is like leasing something.

The short-term financials look good, but disregards the risks and costs of going to cloud. That my SMB IT friends don’t make this more clear to their clients is really frustrating.

Backup is a great use-case for cloud, you address the risk of local problems, so I get that. But office 365/email/outlook? No thanks. But MS just makes it so much cheaper/easier, especially for SMB.

bassomitron@lemmy.world on 23 Nov 2023 22:19 collapse

Agreed on all points. Backup is indeed often a great candidate for cloud. Like you said, it’s usually cheaper and safer in the long run and addresses all the checklist items you’d have to implement locally for redundancies and security.

All these vendors forcing us to move to a rent based economy is tiresome.

KpntAutismus@lemmy.world on 23 Nov 2023 13:39 next collapse

most importantly, surveillance of your employees should be illegal altogether. it already is in germany. (well kind of, you can’t use surveillance footage as evidence to fire someone)

agent_flounder@lemmy.world on 23 Nov 2023 16:41 collapse

Interesting that video isn’t allowed. Like, someone walks into a server room and literally steals servers in plain view. (This actually happened where I worked… We didn’t have cameras so I guess you can still catch a person doing that kind of thing)

That said, I would love to see workplace surveillance outlawed. Particularly constant productivity monitoring.

Warning: rant imminent

If you do the work on time, what’s the problem? If I happen to have a day where I am not feeling it and play solitaire for 8 hours, yet I deliver everything expected on time of good quality… Who cares?

That level of surveillance is demeaning, overbearing, and demoralizing.

Companies have way too goddamn much power in the US. Like, we have all this freedom^1 outside of work but at work it’s a fucking fiefdom run by autocratic pricks and their middle management minions.


  1. Terms and conditions apply. Offer fully redeemable for citizens with highest levels of power and wealth. Exceptions may apply including but not limited to race, ethnicity, gender, gender expression, sexual preference, political affiliation, disability, illness. Offer valid only until election of hyper-capitalist fascists, societal collapse from climate change, or the whims of the billionaire elite.
KpntAutismus@lemmy.world on 23 Nov 2023 17:17 collapse

you can still use the video footage as evidence for theft. and then you can fire the person based on that. but firing a person because they don’t look busy enough isn’t allowed.

and i absolutely agree that workplace surveillance is a dick move. there’s supposed to be a certain level of trust that your employee is going to do the work on time.

Windex007@lemmy.world on 23 Nov 2023 14:06 next collapse

The idea behind the tech was noble: The EAI was supposed to mitigate bias and spot ideal candidates by identifying soft skills, cognitive ability, psychological traits, and emotional intelligence during video interviews.

This is nonsensical. Remove the bias from traits specifically in the domain of human experience (soft skills), and take the humans out of the equation?

Derive cognitive ability from facial expressions?

Remove bias by… Using an AI model that will CERTAINLY be biased?

I’m so torn over if the more proper analogy is “snake oil” or “phrenology”

snooggums@kbin.social on 23 Nov 2023 16:17 next collapse

Derive cognitive ability from facial expressions?

Phrenology 2.0

bratosch@lemm.ee on 23 Nov 2023 18:47 collapse

Phrenology?! Who are you, George Combe??

agent_flounder@lemmy.world on 23 Nov 2023 16:24 collapse

I’m going to guess without even reading the article or knowing anything about the tech that, “for some reason,” it doesn’t seem to work for people of color and underrates them significantly.

(I mean, aside from the fact that this whole concept is batshit insane phrenology horseshit)

uriel238@lemmy.blahaj.zone on 24 Nov 2023 00:54 collapse

There’s this bit in Snow Crash where Federal employees get a memo with an expected reading time, knowing the manager will review their reading times and update their personnel files (and opinions) based on those values, so the workers would skim the memo but mind their reading time.

Micromanagement is how you make your workplace toxic, even if your managers like the power.