Same Stats, Different Improvements
from LabPlot@floss.social to programming@programming.dev on 14 Dec 14:54
https://floss.social/users/LabPlot/statuses/113651748128610781

SAME STATS, DIFFERENT IMPROVEMENTS

@programming

After 12 months of managing #bugs, #developers A, B, and C changed their approach.

Assuming a steady flow of bugs of the same kind, whose change is an improvement❓

Boosts appreciated! 🙂 :boost_love:

More generally, the problem is domain independent.

#OpenSource #FreeSoftware #FOSS #FLOSS #Software #Tech #Development #Engineering #Business #Improvement #Software #Programming #Python #InfoSec #Statistics #Linux

Same Stats, Different Improvements

#FLOSS #FOSS #FreeSoftware #Linux #OpenSource #Python #business #development #engineering #improvement #infosec #programming #software #softwareDevelopment #statistics #tech

threaded - newest

IanSudbery@genomic.social on 14 Dec 15:43 next collapse

@LabPlot @programming I'd say its difficult to tell without at formal statistical assessment, but if I had to pick, i'd say B. The difference between pre and post in A is just a continuation of a pre=existing trend. The difference in C looks like it might be reverting to mean over time, or even getting worse than it was prior to the change if the study went on longer.

LabPlot@floss.social on 14 Dec 18:02 collapse

@IanSudbery @programming

Assuming a steady flow of bugs of the same kind, we share the same line of reasoning.

deegeese@sopuli.xyz on 14 Dec 15:55 next collapse

A changed nothing, and I worry they’re managing to the metric.

B stopped opening and closing a large number of trivial bugs.

C did a cull of old bugs and changed their intake behavior but is growing a backlog.

marcos@lemmy.world on 14 Dec 16:22 collapse

A has been consistently improving it since before the change, so it’s only possible that they are managing to the metric if they had earlier access to it.

B may be doing that, but the graph doesn’t actually measure how many bugs you closed. Those ones seem to have decided to manage by the metric, removing the variance but targeting a high, comfortable level.

Agreed on C, they did a large “hey, we will be measured by that now” one time effort and then forgot about the metric.

The change didn’t improve anybody’s performance.

sukhmel@programming.dev on 14 Dec 15:58 next collapse

Also, if this is only a change in managing bugs, nothing may have changed except for more bug tracking for trivial bugs, or the opposite, ignoring more severe bugs

luciole@beehaw.org on 14 Dec 20:57 next collapse

Meh. You can make numbers say anything you want. And any metric ceases being useful once it’s known. All in all these lines tell such a partial story as to be useless and I’m immensely suspicious of any manager that enjoys reading in tea leaves.

bear@lemmynsfw.com on 15 Dec 00:11 collapse

Trick question, not enough information.