Call Of Duty using AI to listen out for hate speech during online matches
(news.sky.com)
from L4s@lemmy.world to technology@lemmy.world on 02 Sep 2023 12:00
https://lemmy.world/post/4313052
from L4s@lemmy.world to technology@lemmy.world on 02 Sep 2023 12:00
https://lemmy.world/post/4313052
Call Of Duty using AI to listen out for hate speech during online matches::The tool, which will monitor voice chat for any bullying and harassment, will be part of Modern Warfare III - the next game in the series - when it launches in November.
threaded - newest
This is the best summary I could come up with:
Publisher Activision said the moderation tool, which uses machine learning technology, would be able to identify discriminatory language and harassment in real time.
Activision’s chief technology officer Michael Vance said it would help make the game “a fun, fair and welcoming experience for all players”.
The issue is exacerbated in popular multiplayer games due to the sheer number of players, with around 90 million people playing Call Of Duty each month.
Activision said its existing tools, including the ability for gamers to report others and the automatic monitoring of text chat and offensive usernames, had already seen one million accounts given communications restrictions.
Call Of Duty’s code of conduct bans bullying and harassment, including insults based on race, sexual orientation, gender identity, age, culture, faith, and country of origin.
Mr Vance said ToxMod allows the company’s moderation efforts to be scaled up significantly by categorising toxic behaviour based on its severity, before a human decides whether action should be taken.
The original article contains 357 words, the summary contains 160 words. Saved 55%. I’m a bot and I’m open source!
Hey, another thing a chatbot could be trained to be good at. That’s actually not a bad idea.
Yeah, it could actually work if it’s tuned properly. Certainly it could at least be an additional tool for moderators.
If only used to flag, then passed to a moderation team for verification, it would work really well to police something that is almost impossible to police otherwise. That said, I’m sure they wont do that, they’ll just let it handle the moderation and ignore the false positives. Honestly, I’m still OK with that, I haven’t used voice chat in games in 20 years because it always devolves into a cesspool. So even bad moderation is better than what we have now.
Training that neural network must have been a treat
I’d guess that it is doing voice to text, then standard automatic moderation on the text, rather than a new AI that understand hateful sounds. Just a guess though. At this point, you could run the voice to text on local machines and pass that off to the server. Of course that means modders could disable the protection, but the vast majority of users wouldn’t be able to do that. It would also give the added benefit of transcriptions for players that can’t hear voice chat.
Why not get it to misunderstand context on the speach it can’t understand.
Do people use CoD VOIP chat for anything but slurs, bullying, & harassment?
I can see this leading to fan complaints with stupid over moderation like we’ve seen in text moderation. For example Spanish speakers getting banned for saying “negro” or someone getting removed for naively being tricked into answering a trap question.
I got banned once from something because I said “we found the chink in their armor, boys!” Took me forever to even figure out what word triggered it.
Don’t support of system to get someone to listen back to flagged content could work well. Could be trusted member of the community like DOTA 2s overwatch feature
I mute voice chat because I play games to enjoy myself.
I leave it on so I can hear people on the receiving end rage. We are not the same.
Seriously, considering there is no dedicated server browser and even lobbies are not consistent. What on earth does random voice chat add to the experience? I just hit the mute button on my console as soon as I boot the game
I used to forget my mic was turned on and vape right next to the microphone. That’s an additional use for VOIP chat.
Yeah I forgot about that and hearing some kid’s parent’s marriage failing in the background.
I read that this will only mark the voice chat for human moderation, so I hope they’ll use local language staff. It’ll still have false positives if someone who doesn’t understand the language tries to moderate
It’s associations are gonna be so strong that any human voice will immediately trigger the harassment alarm lol.
Great. Now I’ll never know whose house my mom is at every morning.
If they count “your mom” jokes as hate speech, the dialogue going on in game is just going to plummet to zero.
.
Glad I haven’t played a cod game in years.
There’s already a report button if someone has an issue with it let them report it, this is just going to lead to a ton of false positives or be completely useless.
I’d argue the report button has the same flaws. Woop someone badly in a match? Reported. Report someone making bigoted remarks? You’ll still see them in a lobby weeks later.
Actually ban cheaters nah, police voice chat
It’s not exclusive. A twelve year old yelling slurs into their microphone is easily detectable using modern technology. Why not?
What a stupid take, these are completely different and valid problems with entirely separate solutions. One of which the gaming industry has spent decades fighting and the other they literally just got tools for.
Kids will create new slang for derogatory terms.
It’s “listening for it.”
LOL. This isn’t SETI where you’ll go 30 years without hearing anything. It should find hate speech within seconds. So it either works or not, and we should know already. Which is it?
To boost it in a nostalgia effort.
Just wait until it mishears what is in actuality a man with an Irish accent saying the word “neither”