Linus Torvalds Removes The Bcachefs Code From The Linux Kernel (www.phoronix.com)
from that_leaflet@lemmy.world to linux@lemmy.ml on 30 Sep 00:52
https://lemmy.world/post/36666209

#linux

threaded - newest

just_another_person@lemmy.world on 30 Sep 01:12 next collapse

Good 👍

wurstgulasch3000@feddit.org on 30 Sep 01:27 collapse

Why?

just_another_person@lemmy.world on 30 Sep 01:36 next collapse

Seriously?

BombOmOm@lemmy.world on 30 Sep 01:44 next collapse

Not all of us know what this is. Can you expand on your thoughts?

just_another_person@lemmy.world on 30 Sep 02:13 next collapse

hackaday.com/…/the-ongoing-bcachefs-filesystem-st…

nixon@sh.itjust.works on 30 Sep 02:16 collapse

Thanks!

nixon@sh.itjust.works on 30 Sep 02:15 collapse

Agreed!

I don’t know what this is but it is a topic I am somewhat familiar with and it is somehow significant enough to be a headline.

Curious minds would like to know more.

wurstgulasch3000@feddit.org on 30 Sep 01:48 next collapse

Yes I’m asking for the reason why you think this development is good. It seemed to me like it could have worked out if they talked it out and could have added something of value to the OS

just_another_person@lemmy.world on 30 Sep 02:12 collapse

Very easy to search, but you’re lazy so:hackaday.com/…/the-ongoing-bcachefs-filesystem-st…

wurstgulasch3000@feddit.org on 30 Sep 02:17 next collapse

I’ve heard about this and wanted to hear your opinion on it because you seemed to have gotten to another conclusion than I have. But it seems that you’re not interested in discussing so I’m no longer interested

nixon@sh.itjust.works on 30 Sep 02:25 next collapse

It’s not lazy to ask someone who seems to know something about the topic within a discussion thread about said topic. You know more than I do on this.

I understand how you may not want to take the time to answer someone’s question but also you could have replied with the link you eventually did instead of saying “Seriously?” Within the context of calling others lazy you could also qualify under the same term since you took the time to respond but not with the answer.

With search being what it is nowadays I wouldn’t know if I am getting a good result to find out the answer since it is of a technical and specific nature I may or may not even know if I am familiar with to begin with. It could take me much longer to figure it out, or I will give up and not be interested in finding out more about a field you seem to have an interest and knowledge about and I am demonstrating I want to know more about.

I think it is fair to ask for more information from someone who shows more expertise in the topic before searching.

just_another_person@lemmy.world on 30 Sep 10:39 collapse

It is

prex@aussie.zone on 30 Sep 11:18 collapse

no u

patatahooligan@lemmy.world on 30 Sep 11:15 collapse

There’s no reason to be rude and insulting. It doesn’t make the other person look lazy; it just makes you look bad, especially when you end up being wrong because you didn’t do any research either. The article is garbage. It’s obviously written by someone who wants to talk about why they don’t like bcachefs, which would be fine, but they make it look like that’s why Linus wanted to remove bcachefs, which is a blatant lie.

Despite this, it has become clear that BcacheFS is rather unstable, with frequent and extensive patches being submitted to the point where [Linus Torvalds] in August of last year pushed back against it, as well as expressing regret for merging BcacheFS into mainline Linux.

But if we click on the article’s own source in the quote we see the message (emphasis mine):

Yeah, no, enough is enough. The last pull was already big.

This is too big, it touches non-bcachefs stuff, and it’s not even remotely some kind of regression.

At some point “fix something” just turns into development, and this is that point.

Nobody sane uses bcachefs and expects it to be stable, so every single user is an experimental site.

The bcachefs patches have become these kinds of "lots of development during the release cycles rather than before it", to the point where I’m starting to regret merging bcachefs.

If bcachefs can’t work sanely within the normal upstream kernel release schedule, maybe it shouldn’t be in the normal upstream kernel.

This is getting beyond ridiculous.

Stability has absolutely nothing to do with it. On the contrary, bcachefs is explicitly expected to be unstable. The entire thing is about the developer, Kent Overstreet, refusing to follow the linux development schedule and pushing features during a period where strictly bug fixes are allowed. This point is reiterated in the rest of the thread if anyone is having doubts about whether it is stated clearly enough in the above message alone.

just_another_person@lemmy.world on 30 Sep 12:16 collapse

Ohhhh nooooo 🙀

SwooshBakery624@programming.dev on 30 Sep 04:55 next collapse
fmstrat@lemmy.nowsci.com on 30 Sep 06:53 collapse

No, comment is not true. You can use ZFS or BTFS, both of which are open source. ZFS just happens to be historically funded by Oracle, which is a good thing.

The reason is bcachefs has major stability problems (that don’t allow it to meet kernel release schedules). hackaday.com/…/the-ongoing-bcachefs-filesystem-st…

@BombOmOm@lemmy.world

@nixon@sh.itjust.works

nixon@sh.itjust.works on 30 Sep 08:27 next collapse

Thank You!!

just_another_person@lemmy.world on 30 Sep 10:37 next collapse

This is a bot lollllll

monovergent@lemmy.ml on 30 Sep 21:20 collapse
geneva_convenience@lemmy.ml on 30 Sep 21:41 next collapse

Oracle funding doesn’t sound like a good thing at all since they’re basically CIA cloud ran by one of the most influential Zionists. But an unstable filesystem sounds even worse.

fmstrat@lemmy.nowsci.com on 01 Oct 06:02 next collapse

Everyone always says “Companies should fund FOSS instead of spending money on big corpos!”, yet then this.

It’s FOSS. It’s auditable. Funding is a good thing.

geneva_convenience@lemmy.ml on 01 Oct 06:39 next collapse

That’s true, but we also know that funding can come with stipulations. Oracle is an especially sketchy company.

But that counts for all big tech I guess.

fmstrat@lemmy.nowsci.com on 01 Oct 09:06 next collapse

In this situation it works well, IMO. For some more context, ZFS was created by Sun (FOSS). Oacle bought them and built Oracle ZFS out of it. OpenZFS forked at that point from Sun code, and that’s what we use in Linux/etc. The Oracle variant supplies support to the FOSS variant. So Oracle has no control over OpenZFS.

Auli@lemmy.ca on 01 Oct 16:05 collapse

So not using Linux at all then? Most of the development is paid for by big tech.

geneva_convenience@lemmy.ml on 01 Oct 16:16 collapse

My comment moreso pertains to the “which is a good thing” part of the previous one.

HiddenLayer555@lemmy.ml on 01 Oct 22:30 collapse

Google managed to backdoor Linux and Firefox with their “FOSS” libWebp. Took literally years until some security researcher not affiliated with any of them found the bug by chance and made a public report, and by then it had already been explited by NSO for ages. If they had worked for Google (or Apple/Microsoft/Amazon/any of the other corporations that just imported Google’s libWebp code without looking at it) they would have gotten silenced and the exploit would still be there as a gift to Israel. Turns out just because it’s auditable doesn’t mean it gets audited before it’s too late.

fmstrat@lemmy.nowsci.com on 02 Oct 07:20 collapse

And so have countless closed-source developers/companies/applications. A vulnerability existing does not change the fact that FOSS projects should be funded more.

Auli@lemmy.ca on 01 Oct 16:04 collapse

Open ZFS is now the main branch as far as I remember.

LeFantome@programming.dev on 30 Sep 23:04 collapse

“Major stability problems”. Hilarious. Get one person that actually uses bcachefs to confirm that. Good luck.

Kent has stability problems and drives me crazy but that is a baseless hit piece. Bcachefs is a solid fs.

Linus has not pushed back on the quality of bcachefs other than to say it is too unproven to rely on (too new). What Linus objected to was the process violations and the attitude of the lead developer.

Given how much Linus and the other LKML devs wanted to get rid of Kent, the fact that it took so long to dump him tells us that they really wanted to keep bcachefs (the technology).

There may have been more data loss bugs in btrfs and even OpenZFS than bcachefs since it was added to the kernel. I have many bcachefs systems. I have one btrfs system. Guess which one has caused me problems.

fmstrat@lemmy.nowsci.com on 01 Oct 06:06 collapse

Fair enough on “major”. Edited that. But it has stability issues that aren’t handled well enough for RCs, so it’s not a hit piece to state that fact. Those stability issues may come from it being new, but it’s still an issue. Saying it’s because they want to “get rid of Kent” is just as much of a hit piece, too.

LeFantome@programming.dev on 01 Oct 13:59 collapse

The dev is unstable. And he made the kernel process chaotic. But the filesystem itself is pretty solid. Do you have a link to stability issues?

fmstrat@lemmy.nowsci.com on 01 Oct 15:31 collapse

My understanding is the stability risks come from active development additions vs “fixes” during that stage of the development cycle.

linuxiac.com/torvalds-expresses-regret-over-mergi…

Simply put, only small bug fixes are allowed after the post-merge phase to integrate changes into the current kernel cycle. However, Overstreet’s PR included more than just fixes; it continued to develop new features, which always carry risks. That’s why Torvalds was unhappy with it. As a result, the changes were rejected.

…

Currently, the file system is being actively developed. Although it shows great potential with impressive features and strong data reliability, it’s not yet stable enough to be adopted by major Linux distributions as a proven and reliable solution.

YMMV, but my production systems will stick with ZFS since it’s kernel release updates are clear when there are “upgrades” vs “updates”, as you do those manually when it alerts you.

“Stable” in this context doesnt mean “your PC will definately crash and you will lose data!”, bcachefs is well past that. It means that the development is too active to be considered production ready since the code changes are too large to confirm the scary bit won’t happen (as much as can be).

Even JC threw in the towel on bcachefs-tools due to this: www.phoronix.com/…/Debian-Orphans-Bcachefs-Tools

LeFantome@programming.dev on 02 Oct 15:16 collapse

You certainly don’t have to use bcachefs. I love it but several of my systems will come off it Joe that it is out of the kernel. But not for technical reasons.

It is not that he changes were scary. Nobody had a problem with the changes. It was entirely process. It was “when” the changes were being submitted.

Kent always sent stuff in after the merge window. And when Linus rejected them, due to timing, Jent would throw a massive fit and start insulting everybody. Ironically he would complain about having to put up with “drama” from Linus.

So, Linus kicked him out.

Nothing to do with the code.

interdimensionalmeme@lemmy.ml on 30 Sep 02:27 next collapse

They want you to use Oracle ZFS instead, they have a lot of money riding on this.

Auli@lemmy.ca on 01 Oct 16:03 collapse

Who Torvalds? No the developer likes to do his own thing so he can now do his own thing.

whaleross@lemmy.world on 30 Sep 11:07 next collapse

It was nowhere close to be mature enough to be in the kernel. The developer is nowhere close to be mature enough to be involved in the kernel. It’s better for everybody if it is developed separately and maybe integrated again at a later stage when the file system and tooling are considered stable and changes are smaller and less sensitive. CacheFS being in the kernel might mislead people to rely on a filesystem that is still experimental and under heavy development. Personally I am looking forward to see it mature because I’d love to run it on my file storage home server when it is stable enough.

eldavi@lemmy.ml on 30 Sep 17:58 next collapse

It was nowhere close to be mature enough to be in the kernel. The developer is nowhere close to be mature enough to be involved in the kernel

what independently verifiable condition(s) will satisfy these requirements?

whaleross@lemmy.world on 30 Sep 19:22 collapse

That the developer himself finds it absolutely necessary to push new code outside the window for upcoming versions of the kernel is a pretty good indication.

LeFantome@programming.dev on 30 Sep 22:02 collapse

That is a personality issue, not a code emergency.

There were two dozen patches submitted for 6.17 that were never merged. What has the fall-out been? Where are all the stories about data loss? I am sure they would hit the front page.

The file system can improve but it is already fine.

whaleross@lemmy.world on 30 Sep 22:56 next collapse

The fallout for people knowingly risking their data beta testing a filesystem that is still in experimental and some users running into issues and possibly corruption?

There are no stories because it is not a story when a test environment for finding bugs fails and the bugs get fixed. Nobody with data they can not lose are putting it on bcachefs because why would they.

Thanks for running a test environment though. Please take backups of anything important, just in case.

gian@lemmy.grys.it on 01 Oct 07:20 collapse

That is a personality issue, not a code emergency.

True, but it is an indication that the developer cannot follow a common rules. Simply Torvalds was tired of how he behaved.

There were two dozen patches submitted for 6.17 that were never merged. What has the fall-out been? Where are all the stories about data loss? I am sure they would hit the front page.

And so ? A patch can be submitted but never merged, for whatever reason. Problem is: these two dozen patches were submitted during the -RC cycle ?

The file system can improve but it is already fine.

Good. Now it it the developer that need to improve his attitude to work in teams.

LeFantome@programming.dev on 30 Sep 21:58 collapse

I have been relying on the filesystem. It is excellent. It is mature enough.

Sadly, the lead dev for bcachefs is not mature enough.

jaxxed@lemmy.world on 01 Oct 05:20 collapse

I agree, on both statements.

It is easily stable enough for experimental use.

phoenixz@lemmy.ca on 01 Oct 14:29 collapse

Not really why op said, though. It’s stable enough for exeprimental use

jaxxed@lemmy.world on 01 Oct 15:37 collapse

It’s marked as experimental, hence the “experimental”

non_burglar@lemmy.world on 30 Sep 15:57 collapse

The developer of bcachefs, Kent Overstreet, has repeatedly failed to abide by the expectations of kernel release schedules, particularly the rc (release candidate) stage, which is supposed to freeze new features until next release.

Kent has open-air arguments with Linus Torvalds about not being able to develop the way he wants to, Linus Torvalds does not like wasting time discussing it with Kent.

IMO, Kent created this situation himself. He’ll be happier developing outside upstream anyway.

It should be noted that while some folks have commented that bcachefs was not ready for upstream, several kernel devs have a lot of respect for the technical quality of Kent’s work, so I think the argument of whether bcachefs is good or not good is separate from Kent’s behaviour as a kernel contributor.

jaxxed@lemmy.world on 01 Oct 05:18 next collapse

Additionally, Kent got most of his kernel changes needed for bcachefs merged already, so a dkms should be easier to manage now.

buttnugget@lemmy.world on 01 Oct 13:58 collapse

So if I’m reading this correctly, the program can operate fine as an external module because the kernel itself supports it well with those changes?

jaxxed@lemmy.world on 01 Oct 15:36 collapse

To be more clear, before he got his code mainlined, you needed to run h8s full fork of the kernel, with changes made not just to the cache code itself, but also to other parts.

Not all of his changes went in though; but the differences got sorted out enough that the vast majority of his newer changes were driver only.

That said, he was still ruffling feathers about wanting some fast moving kernel changes.

buttnugget@lemmy.world on 02 Oct 05:35 collapse

Thanks for the detailed explanation!

jaxxed@lemmy.world on 02 Oct 12:47 collapse

Not an expert though, but have been watching bcachefs for … what feels like a decade.

buttnugget@lemmy.world on 03 Oct 00:27 collapse

Hey, BCA chefs are hard to fully master so I get it.

Auli@lemmy.ca on 01 Oct 16:00 collapse

Problem is if it isn’t in the kernel it well be used by a lot less people.

erock@lemmy.ml on 30 Sep 02:51 next collapse

I’ve never used bcachefs and only recently read about some of the drama. I wish the project the best but at this point it is hard to beat zfs

non_burglar@lemmy.world on 30 Sep 15:22 next collapse

They don’t really compete on the same features, but I get what you mean.

daggermoon@lemmy.world on 01 Oct 08:15 collapse

zfs is confusing as hell for noobs like me. I only really recently learned how to use btrfs. Is there any real reason to use zfs over btrfs on Linux anyway?

Tiuku@sopuli.xyz on 01 Oct 11:11 next collapse

There are some niche features, but if you’re not aware of them then no. It’s just licence encumbered btrfs for the majority of us.

Matriks404@lemmy.world on 01 Oct 11:29 next collapse

I have used btrfs exactly once because it was the default on openSUSE, and the filesystem eventually became corrupted and unrecoverable.

Jakeroxs@sh.itjust.works on 01 Oct 13:19 next collapse

On top of being confusing, I had my whole proxmox node crash because the ZFS pool randomly crashed out multiple times 🤷‍♂️

Probably due to the consumer grade nvme I was using it on but… Still why?

Also used a lot of extra ram just to function

_stranger_@lemmy.world on 01 Oct 14:58 collapse

I think it’s just hardware optimization. You get a ton more pain and risk replacing a drive in zfs vs raid10, but it’s more space efficient and flexible to use zfs. This is all academic, because the goal of these systems is a certain level of performance, availability, and data integrity, but not data safety. You need backups (preferably off-site and even off line) backups for that.

Jakeroxs@sh.itjust.works on 01 Oct 15:14 collapse

To be clear, I didn’t lose any data, ended up moving everything off the ZFS pool and went back to ext, the crashes I had just made the ZFS unavailable until I rebooted the machine.

Auli@lemmy.ca on 01 Oct 15:57 collapse

No unless your doing raid 5 or 6 not there isn’t.

enumerator4829@sh.itjust.works on 01 Oct 21:04 collapse

Friends don’t let friends run erasure coding on BTRFS.

Personally, I don’t run anything on BTRFS. I like having my data intact and I also want two parity drives in my pools.

ryannathans@aussie.zone on 30 Sep 04:06 next collapse

Should have never been merged into the kernel lol

jaxxed@lemmy.world on 01 Oct 05:22 next collapse

Definitely not going anywhere near the comments section on that phoronix article. It’s guaranteed to be pure poison.

xiwi@lemmy.dbzer0.com on 01 Oct 08:12 collapse

Tbh, what phoronix comment section isn’t pure neurological poison?

daggermoon@lemmy.world on 01 Oct 08:12 collapse

Kent is such a dumbass. It’s a pitty because it’s a great filesystem.