Participants rated the same text presented in Wikipedia lower than in ChatGPT or Alexa for credibility (en.wikipedia.org)
from Aatube@kbin.melroy.org to technology@lemmy.world on 04 Sep 2024 16:15
https://kbin.melroy.org/m/technology@lemmy.world/t/442173

Identical text perceived as less credible when presented as a Wikipedia article than as simulated ChatGPT or Alexa output. The researchers note that these results might be influenced by the fact that it is easier to discern factual errors on a static text page like a Wikipedia than when listening to the spoken audio of Alexa or watching the streaming chat-like presentation of ChatGPT.

However, exploratory analyses yielded an interesting discrepancy between perceived information credibility when being exposed to actual information and global trustworthiness ratings regarding the three information search applications. Here, online encyclopedias were rated as most trustworthy, while no significant differences were observed between voice-based and dynamic text-based agents.

Contrary to our predictions, people felt higher enjoyment [measured using questions like "I found reading the information / listening to the information entertaining"] when information was presented as static or dynamic text compared to the voice-based agent, while the two text-based conditions did not significantly differ. In Experiment 2, we expected to replicate this pattern of results but found that people also felt higher enjoyment with the dynamic text-based agent than the static text.

Edit: Added "for credibility" to title

#alexa #chatgpt #technology #truth #wikipedia

threaded - newest

ptz@dubvee.org on 04 Sep 2024 16:20 next collapse

We’re fucked.

TheBat@lemmy.world on 04 Sep 2024 18:30 collapse

It’s ok, it’ll be all over soon*

*^Subject to geological time scale^

Zoomboingding@lemmy.world on 04 Sep 2024 18:52 collapse

20,000 years of this, 7 more to go!

Wilzax@lemmy.world on 05 Sep 2024 01:22 collapse

Adjusted for time since release, 4 more to go!

Boozilla@lemmy.world on 04 Sep 2024 16:36 next collapse

I wonder if Wikipedia could mitigate this to some degree by updating their UX. I don’t particularly want them to, and I certainly don’t want a “New Coke” Wikipedia. But the design is rather plain and “looks old” to a modern user.

And people are suckers for a friendly-looking starter like “Certainly!”

Blisterexe@lemmy.zip on 04 Sep 2024 16:58 next collapse

Well, they could just have a wikipedia.org and old.wikipedia.org and have the option for it to redirect

ptz@dubvee.org on 04 Sep 2024 17:00 next collapse

They did recently, or at least within the last year or so. Naturally, I hate it. lol

lemann@lemmy.dbzer0.com on 04 Sep 2024 17:30 collapse

I’ve seen the redesign too and not really sure how I feel about it 😂 there’s a lot of additional whitespace and it kinds looks like a blown up mobile version of the site

ptz@dubvee.org on 04 Sep 2024 17:33 next collapse

The whitespace and the popovers. I get really annoyed reading a page and accidentally bump the cursor over something and a popup preview covers up what I’m reading. Or I’ll be scrolling with the keyboard and a linked word scrolls under the cursor and the popover appears. Then it triggers popovers on every word as I move the mouse out of the way.

Feels like navigating a mine field. That’s the part I’m most split on: sometimes I find that useful, most times it’s a nuisance.

Tehdastehdas@lemmy.world on 05 Sep 2024 08:15 next collapse

linked word scrolls under the cursor and the popover appears

Nobody wants that. It’s bug report worthy.

Aatube@kbin.melroy.org on 05 Sep 2024 10:59 collapse

How would you fix it? HTML hover triggers don’t care if you scrolled.

Aatube@kbin.melroy.org on 05 Sep 2024 10:58 collapse

Page previews are unrelated to and have been around before the redesign. You can turn it off by clicking on the cog in the corner of the preview. To avoid the minefield issue… just move your cursor outside the minefield? This is yet another thing limited width helps, but you can still have your cursor stay at the unibar.

Aatube@kbin.melroy.org on 04 Sep 2024 17:56 collapse

I made https://meta.wikimedia.org/wiki/User:Aaron_Liu/v22.css to fix that. Otherwise I adore the design.

webghost0101@sopuli.xyz on 04 Sep 2024 17:30 next collapse

www.wikiwand.com is what your looking for, its basically a wrapper with a modern UI

If you visit the site straight from the web there may be ads but if you use the extension there shouldn’t be

They are also a leading donor to wikipedia so its not like they’re just stealing content for profit. You may indirectly do more to get money in wikipedia their hands then you do by visiting the main site.

noodlejetski@lemm.ee on 04 Sep 2024 17:52 next collapse

from Wikiwand’s description:

Welcome to Wikiwand, an AI-driven wiki aggregator created to enhance user experience on Wikipedia by streamlining knowledge consumption.

We integrate AI alongside, not as a replacement for, the full-contextual articles from Wikipedia, Wikiquote, and Wiktionary.

By leveraging cutting-edge AI technologies, Wikiwand helps users quickly grasp key points and related topics without the need to sift through lengthy articles.

oh how the mighty have fallen.

webghost0101@sopuli.xyz on 04 Sep 2024 19:22 next collapse

I mean yeah they do have an ai chat feature but i literally never used it and honestly forgot its there.

Honestly the quote from their site confuses me, i ve used since before ai buzz started and i have not noticed much difference so i am not sure what they mean with being ai drive, maybe just marketing?

Not a good look admittedly but i’d say it’s the actual product that counts, which really is just modern wikipedia ui.

Aatube@kbin.melroy.org on 04 Sep 2024 19:48 collapse

I don’t use Wikiwand because I don’t like the interface, but IMO that’s just how they attract funding.

DannyBoy@sh.itjust.works on 04 Sep 2024 17:57 next collapse

It’s modern alright, complete with an “AI tools sidebar” and a “please login” popup that takes up half the screen.

Aatube@kbin.melroy.org on 04 Sep 2024 17:59 collapse

There's no login popup and you can easily hide the sidebar, just like Wikipedia's skin.

DannyBoy@sh.itjust.works on 04 Sep 2024 18:10 collapse

Ah, I must’ve clicked on a premium theme on the way in.

stefenauris@pawb.social on 04 Sep 2024 18:08 collapse

Love this extension <3

Aatube@kbin.melroy.org on 04 Sep 2024 17:58 next collapse

I don't see how you could do that while having it stay an encyclopedia.

Boozilla@lemmy.world on 04 Sep 2024 18:04 collapse

Not sure I follow you. An update of the visuals / presentation doesn’t change the inherent nature of it. Books get republished with new dust jackets all the time.

Aatube@kbin.melroy.org on 04 Sep 2024 18:11 collapse

People liked the ChatGPT presentation because it slowly revealed the text (which also made errors harder to discern). To update and adapt it would be doing away with the encyclopedia format. If you want a ChatGPT presentation, just use ChatGPT or that OneWordReader thing.

Boozilla@lemmy.world on 04 Sep 2024 18:22 collapse

OK, now I understand. I think we’re talking about different things here. Or I missed that point in the paper. I would not want that kind of thing for Wikipedia, I agree with you there.

drosophila@lemmy.blahaj.zone on 04 Sep 2024 19:52 next collapse

Make the page 15x more bloated with JavaScript popups and it’ll be “modern”.

[deleted] on 04 Sep 2024 22:18 collapse

.

MigratingtoLemmy@lemmy.world on 04 Sep 2024 22:40 collapse

Wtf, the general population must be a bunch of morons

Aatube@kbin.melroy.org on 04 Sep 2024 22:44 collapse

Of course they're morons when they slave away as wage cogs instead of exercizing their smarts.