Microsoft's Pricey AI Assistant Copilot Leaves Early Adopters Feeling Cheated (www.ibtimes.co.uk)
from throws_lemy@lemmy.nz to technology@lemmy.world on 19 Feb 2024 15:04
https://lemmy.nz/post/7054680

#technology

threaded - newest

Reverendender@sh.itjust.works on 19 Feb 2024 15:13 next collapse

It’s because it’s not as good

FMT99@lemmy.world on 19 Feb 2024 15:30 next collapse

… In contrast, Microsoft’s corporate VP, Jared Spataro, told us that users are finding immediate value in Copilot

haha no really?

aniki@lemm.ee on 19 Feb 2024 15:53 collapse

Guy who’s job it is to sell a product, lies to sell a product.

kescusay@lemmy.world on 19 Feb 2024 16:00 next collapse

Copilot isn’t actually bad for developers, it’s just that you need to be careful with it and recognize its limitations.

Writing a bunch of REST endpoints for an API and need to implement all the typical http verbs, and you already have all the matching methods for reading, updating, and deleting values in a complex SQL database for each endpoint to call? Copilot can turn a ten minute chore into a ten second one. Very handy.

Writing those complex SQL methods in the first place? Yeah… Copilot will probably make a ton of mistakes and its work will need to be triple-checked. You’ll save time just doing it yourself if you know how. (And if you don’t, you have no business calling yourself a developer.)

Copilot is best for easy boilerplate and repetitive code. Problems arise as soon as you ask it to get “creative.”

DumbAceDragon@sh.itjust.works on 19 Feb 2024 16:07 next collapse

This is about the other copilot.

kubica@kbin.social on 19 Feb 2024 16:19 next collapse

microsoft and its names... like the VS editor and the other VS editor.

ioslife@lemmy.ml on 19 Feb 2024 16:23 next collapse

Does Microsoft own GitHub?

iAmTheTot@kbin.social on 19 Feb 2024 16:25 next collapse

Yes.

kate@lemmy.uhhoh.com on 19 Feb 2024 16:42 next collapse

Yes

NightAuthor@lemmy.world on 20 Feb 2024 14:08 collapse

And linked in

eager_eagle@lemmy.world on 19 Feb 2024 17:07 next collapse

Google is following their lead with Gemini, it seems. What is wrong with them?

tourist@lemmy.world on 19 Feb 2024 20:05 collapse

where is windows 9
where is xbox two

elvith@feddit.de on 19 Feb 2024 20:46 collapse

And Xbox three to Xbox 359?

kescusay@lemmy.world on 19 Feb 2024 18:55 next collapse

Yeah, I figured that out eventually, but also figure the same probably applies to the other Copilot. Same underlying technology.

Wish Microsoft would use different names for different implementations.

tabular@lemmy.world on 19 Feb 2024 19:32 collapse

Do you mean a revision or a different “copilot”. If the latter then this confusion is brought upon by Microsoft, the company that names a successor to a gaming console “Xbox One”.

TimeSquirrel@kbin.social on 19 Feb 2024 16:54 next collapse

One time I decided for shits and giggles to just keep pushing tab and see where it went. It didn't take long for it to enter a useless recursive loop, hallucinating a new iteration of the same thing on each line.

It definitely isn't gonna magically think up new algorithms for you. I don't know what everybody is scared of. It ain't even gonna replace my kid programming on Scratch.

joel_feila@lemmy.world on 20 Feb 2024 05:06 next collapse

It will if employeers only want ai code

kelvie@lemmy.ca on 20 Feb 2024 05:20 collapse

I mean didn’t we all do this when phones started autocompleting sentences like a decade ago? (Or however long it was, time perception is fickle)

lemmyvore@feddit.nl on 19 Feb 2024 18:45 next collapse

Copilot isn’t actually bad for developers, it’s just that you need to be careful with it and recognize its limitations.

Is it me or is this a weird statement for what’s supposed to be an exact science?

Imagine working in construction and using a level and you’re told “it’s not that it’s a bad level, you just gotta be careful with it”.

How much margin for error should we allow for getting our code right? Is it now acceptable if we only get 80% right?

kescusay@lemmy.world on 19 Feb 2024 18:56 next collapse

It’s more like you get some kind of weird construction multitool that promises to be a level, a drill, a hammer, and a dozen other things, and it turns out to be a really good, innovative, and helpful level… and a really bad everything else.

birbs@lemmy.world on 20 Feb 2024 00:27 next collapse

As a software developer I promise you that software development is very much not an exact science.

Programs are complex and there are so many different ways of achieving the same thing that all code has problems and gets a bit messy in places. You can test, but it’s not easy to ensure that everything works the way it should.

The best code you’re going to get will probably be in the space industry, but even that will have bugs. The best you can do is make the code robust even when bugs make things go wrong.

In many cases copilot will do just as well as a junior developer. It’s very good at repetitive tasks and filling gaps in your existing code.

pezhore@lemmy.ml on 20 Feb 2024 01:54 collapse

I use copilot a bit for my work - and I treat it like copy-paste from StackOverflow - sure that codeat look right, but you’ve gotta double check it and test it a few times before you commit and push.

friend_of_satan@lemmy.world on 20 Feb 2024 00:46 collapse

Always ask it to write tests for the code it generates. Of course, then you have to validate that the code works AND that the tests work.

anotherandrew@lemmy.mixdown.ca on 20 Feb 2024 14:18 collapse

Or just write the damn thing yourself and save a bunch of headaches and wondering if you got the tests right it if there’s some screwy corner case lurking because of its implementation.

Rexios@lemm.ee on 19 Feb 2024 16:26 next collapse

So people are surprised that GPT-4 is performing as well as GPT-4 always has?

Bipta@kbin.social on 19 Feb 2024 17:45 collapse

Copilot isn't GPT4, as far as I know. GPT4 hallucinations are quite minimal.

Rexios@lemm.ee on 19 Feb 2024 19:43 next collapse

If it isn’t GPT-4 what is it?

Rai@lemmy.dbzer0.com on 20 Feb 2024 04:52 collapse

GPT-3

Hotzilla@sopuli.xyz on 20 Feb 2024 05:13 collapse

It Iis GPT4-turbo, which is same gpt that openai uses now. It is not as good as original GPT4

M500@lemmy.ml on 19 Feb 2024 22:56 collapse

In the ios app there is literally a switch that turns on gpt-4. I am not sure what it is using when the switch is off though.

dylanTheDeveloper@lemmy.world on 20 Feb 2024 05:34 collapse

Sweatshop children in a foreign land

Raxiel@lemmy.world on 20 Feb 2024 08:54 collapse

Technically still a neural network.

FenrirIII@lemmy.world on 19 Feb 2024 16:44 next collapse

Yes, but when will it make porn?

M500@lemmy.ml on 19 Feb 2024 22:57 collapse

They already have porn chatbots.

Spiralvortexisalie@lemmy.world on 20 Feb 2024 03:23 collapse

The bosses are airborne while I can’t work online, so I generate my porn on the company’s time.

eager_eagle@lemmy.world on 19 Feb 2024 17:06 next collapse

Similarly, other users told the outlet that the AI hallucinated wrong answers or miscalculated spreadsheets. AI experts, including The Wharton School professor, Ethan Mollick accused Copilot of making bizarre suggestions for weekend meetings.

It seems these users never used GPT

nyakojiru@lemmy.dbzer0.com on 19 Feb 2024 20:11 next collapse

It’s ChatGPT Open AI, but as Microsoft LoVES to do things, bloated as those old time web browsers infested of tool bars

Hotzilla@sopuli.xyz on 20 Feb 2024 05:27 collapse

It is multiple things, in chat it is just GPT4-turbo, with support to request data through Microsoft Graph API. So basically it can do API searches to data you have access.

In Excel, it can perform things like formulas, with context of your excel sheet. This is actually quite useful.

But still bit disappointed, the system prompt of copilot is in my opinion not as good as open AI’s.

thragtacular@kbin.social on 19 Feb 2024 22:49 next collapse

What part of "early adopter" did you not understand before you wasted your money?

BrightCandle@lemmy.world on 19 Feb 2024 23:18 next collapse

As far as I am concerned Copilot is a giant theft of open source code and breaches the license. I expect in the future a lot of repositories will be used to poison these AI agents just as is happening with images. The agents will get better but the quality of what they produce will also be poisoned and get worse precisely due to the theft.

barsoap@lemm.ee on 20 Feb 2024 04:03 collapse

Poisoning code should be ludicrously easy: They crawl pretty much everything and a random AST walk looks suspiciously like real code while it’s the equivalent of showing an image generation model noise. Or maybe better: Mondrians that are indistinguishable from Vermeers. (I hope I didn’t offend anyone by calling Mondrian abstract nonsense but it is abstract nonsense).

I don’t think copilot will hold out for long anyway, the novelty is wearing off and even inexperienced programmers are beginning to see that it helps you write code faster that shouldn’t have been written in the first place. Code is like 90% maintenance and excessive boilerplate doesn’t make it easier.

OTOH please don’t let that “Let’s scam artists by selling them snake oil that if it wasn’t trivial to circumvent would break naturally within a week” guy fool you. On the actually interesting side of poisoning attacks, people have made cars hallucinate radar blips I bet a couple of companies are getting quite tough questions from regulators right now.

taanegl@lemmy.world on 19 Feb 2024 23:55 next collapse

[redacted]

esc27@lemmy.world on 20 Feb 2024 00:05 next collapse

I have not had a chance to test the office integrations (and the $30 price tag may keep it that way,) but I’ve been testing the web chat version, and once toggled to “precise” mode I find it close to chatgpt. Just a little more prone to lapse into acting like a bing chat app and very limited in conversation length…

I think the trick is to treat it like a junior assistant or maybe an intern who might make mistakes and not as a seasoned, experienced employee who always puts out perfect work.

misanthropy@lemm.ee on 20 Feb 2024 02:46 collapse

$30? Idk how it is in the consumer space, but in the Enterprise world the initial opening for copilot required 300 seats of E3 or better, and then a purchase of 300 seats of copilot 365 at $30 each. They were supposed to drop the 300 copilot 365 seat req q1 but I’m not sure if they did.

3030012=108,000 per year for copilot. E3 is 36 a month, 30012=129,600.

Big money.

esc27@lemmy.world on 20 Feb 2024 03:05 collapse

I’m told they dropped the seat requirements. Yeah $30 is the business rate. No discounts for education. I suspect the backend costs on this are still rather high but should improve once hardware catches up to demand.

misanthropy@lemm.ee on 21 Feb 2024 23:04 collapse

Ah. Well as far as I was told two months back, they didn’t plan on dropping the E3/E5*300 seat requirements, only the 300 seat of copilot requirements. But I haven’t kept on top of it, all my companies clients are too small fish to drop 100-200k a year on unproven tech

From what I’m told, Ms was basically running things at a loss when they first opened the doors.

ShittyBeatlesFCPres@lemmy.world on 20 Feb 2024 02:44 next collapse

It’s funny that Microsoft fucked up the branding so bad that half of these comments are about GitHub Copilot — a specialized, useful tool for experienced developers to speed up rote tasks — and the other half about their whole “Shoehorn AI into everything.” strategy. And Bing Chat is also now Copilot, apparently? Is Cortana now Windows Copilot? Is there an Xbox Copilot that plays Starfield for you?

ArtVandelay@lemmy.world on 20 Feb 2024 04:26 next collapse

Co Xbox Windows pilot

dylanTheDeveloper@lemmy.world on 20 Feb 2024 05:33 collapse

Co pilot pilot for Microsoft Flight Sim 2025

ShittyBeatlesFCPres@lemmy.world on 20 Feb 2024 05:24 next collapse

Remember that internal Microsoft video that leaked where a marketing person was begging them to use Apple’s iPod box designs instead of their usual ones: youtu.be/EUXnJraKM3k?si=3aAZ9xulggtHDVp6

It was apparently 17 years ago but it’s still true that Microsoft can’t brand things for shit.

PipedLinkBot@feddit.rocks on 20 Feb 2024 05:24 collapse

Here is an alternative Piped link(s):

https://piped.video/EUXnJraKM3k?si=3aAZ9xulggtHDVp6

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I’m open-source; check me out at GitHub.

mangofromdjango@feddit.de on 20 Feb 2024 07:55 next collapse

Well copilot is the category of those assistants. Most other companies call them copilots too, even in B2B space

AaronMaria@lemmy.ml on 20 Feb 2024 11:20 collapse

There is a setting for Xbox Controllers to use two of them like it’s the same one called Copilot.

style99@kbin.social on 20 Feb 2024 07:06 next collapse

Trash company once again dumps trash on the market and attempts to sell it to morons.

SrTobi@feddit.de on 20 Feb 2024 11:33 next collapse

This is certainly not about finding fools who not only are beta testers but also provide training data… And not only for free, but they pay also for this… Win win win for M$

whoelectroplateuntil@sh.itjust.works on 20 Feb 2024 11:42 next collapse

My favorite are the gigantic companies falling all over themselves to buy this for their workforces before it’s even clear what value a bot that can’t reliably do arithmetic is going to add to Excel

EatATaco@lemm.ee on 20 Feb 2024 14:28 collapse

According to the article, dow says they’ve seen significant productivity gains and are rolling it out to half the company.

7rokhym@lemmy.ca on 20 Feb 2024 12:09 collapse

Yeah it’s a classic case of Microsoft marketing. So far I found the office integration to be the least useful and most over hyped in marketing. However what it is good at is actually helpful. Join a meeting late it already has an update for what’s happened on the meeting so far and it’s really good for summarizing a meeting especially a key topics and a summary of action items. Tedious tasks like taking data copied from a PDF file and reformatting it correctly in CSV. And my favorite is making custom graphics based on a specific colour palette, though most images are really good for entertainment, demos and samples, but not production quality for final products. Weird results include creepy human images just don’t look right in a disturbing zombie-like way.