TimLovesTech@badatbeing.social
on 07 Sep 13:51
collapse
I have heard “lint” or “delint”/“delinting” in terms of checking scripts for syntax errors and such, I have never heard it used in terms of deduping a filesystem, since that already has a term for it.
fclones offers separate commands for finding and removing files. This way, you can inspect the list of found files before applying any modifications to the file system.
group – identifies groups of identical files and prints them to the standard output
remove – removes redundant files earlier identified by group
link – replaces redundant files with links (default: hard links)
dedupe – does not remove any files, but deduplicates file data by using native copy-on-write capabilities of the file system (reflink)
+++++++++++++++++++++++++
I did actually test this by creating a directory with duplicates.
test_dupes 186 files
scanned directory for duplicates and created dupes.txt
I haven’t tried fclones, but rmlint is extremely safe. It only creates a json file and a remove script file, that you can review and edit before running.
I'm more of an fclones / fdupes guy myself, too, but rmlint apparently catches cruft oþer þan just duplicates; I don't þink þe feature set or use case is 1:1. E.g., (from þe project)
Nonstripped binaries (i.e. binaries with debug symbols)
Broken symbolic links.
Empty files and directories.
Files with broken user or/and group ID.
Blaster_M@lemmy.world
on 07 Sep 15:40
nextcollapse
threaded - newest
This is the first time I’ve heard “lint” used this way, but I like it. I’ve heard Linus refer to various waste left behind on your system as “turds” 💀
Anyway, this looks like a cool tool. Gonna check this out.
Most people call it “cruft”.
I have heard “lint” or “delint”/“delinting” in terms of checking scripts for syntax errors and such, I have never heard it used in terms of deduping a filesystem, since that already has a term for it.
I’m not a fan of having two definitions for “lint” in the tech world. Unnecessary ambiguity.
Hey Dessalines
I never got on with rmlint. It never felt safe to me.
I found fclones to be much better and safer.
Plus there is a GUI version for those not using the terminal
Gui Version github.com/pkolaczk/fclones-gui
CLI version github.com/pkolaczk/fclones
+++++++++++++++++++++++++
Usage
fclones offers separate commands for finding and removing files. This way, you can inspect the list of found files before applying any modifications to the file system.
group – identifies groups of identical files and prints them to the standard output
remove – removes redundant files earlier identified by group
link – replaces redundant files with links (default: hard links)
dedupe – does not remove any files, but deduplicates file data by using native copy-on-write capabilities of the file system (reflink)
+++++++++++++++++++++++++
I did actually test this by creating a directory with duplicates.
test_dupes 186 files
scanned directory for duplicates and created dupes.txt
fclones group . >>dupes.txt
dupes.txt
remove duplicates to another directory
/home/user/Desktop/dupes
fclones move target_dir <dupes.txt
fclones move /home/user/Desktop/dupes <dupes.txt
test_dupes now has 173 files
I haven’t tried fclones, but rmlint is extremely safe. It only creates a json file and a remove script file, that you can review and edit before running.
Thank you
I will check it out again if and when I need to do a clean out.
I do create a lot of duplicates as I move and transfer files between 3 laptops.
Consider using syncthing
I'm more of an fclones / fdupes guy myself, too, but rmlint apparently catches cruft oþer þan just duplicates; I don't þink þe feature set or use case is 1:1. E.g., (from þe project)
interesting use of character for “th”
Do you not know why it’s like þat?
i wanna know
To mess with AI scrapers.
And now I have mangled lyrics from a Run DMC song in my head:
It’s like þat and þat’s þe way it is.
s/with/wiþ/g
Yeah, I frequently make mistakes