Reminder to clear your ~/.cache folder every now and then
from Zangoose@lemmy.world to linux@lemmy.ml on 03 Dec 2023 00:30
https://lemmy.world/post/9065720
from Zangoose@lemmy.world to linux@lemmy.ml on 03 Dec 2023 00:30
https://lemmy.world/post/9065720
A screenshot of a file manager preview window for my ~/.cache folder, which takes up 164.3 GiB and has 246,049 files and 15,126 folders. The folder was first created about 1.75 years ago with my system
Alt Text
threaded - newest
Question, could you have cron/crontab do it monthly or something? Do it monthly meaning delete everything in ~/.cache every month or so?
.
This is the good shit I miss from reddit. Thank you for posting a systemd service config, I'm going to implement this.
Thanks for this! I’ve been meaning to start getting into learning more about systemd and making services, this is super detailed and gives me a pretty good starting point!
You could have a cronjob run something like
find /home/user/.cache -type f -atime +30 -delete, which would find files that haven’t been accessed in the last 30 days and delete them. Make sure your home partition is not mounted with thenoatimeoption though.I just found this today, I don’t really know anything about cron jobs but this will probably incentive me to learn lol
Did you happen to see which subdirectory was using up this much space? I don’t think I’ve ever seen .cache go above 10GB, so this may be a bug in a piece of software you use.
Running
ncduon it would’ve been cool to see.<img alt="" src="https://lemmy.world/pictrs/image/1db16aff-0fdf-421a-84d4-77091efdea1a.png">
<img alt="" src="https://lemmy.world/pictrs/image/723e165b-7648-48d1-92c5-5e655172326d.png">
Looks like yay is storing every previous binary for AUR bin packages (also excuse the unreadable terminal theme, it doesn’t play very well with a lot of TUI apps unless they support custom theming)
Wow, I’ve never seen something like this.
Is it" allowed"? I mean, there are quotas for user homes.
You should run
yay -Scfrom time to time. This cleans a) your pacman cache (which is normally done by executingpacman -Sc) b) your AUR build cache, which is what’s taking up 160GB. But this one seems rather unusual, I use paru (which also has the commandparu -Sc), so I can’t really tell if this is normal with yay.The command also asks you for every directory if you want to delete it or not, so it’s completely save to run that command.
Something I noticed was that it was mostly the binary packages that were taking up so much space, it may be because of how yay stores the programs (does it use git?), the ones that were compiled from source code usually took up the least amount of space, while the binary programs were the ones taking up tens of gigabytes
Indeed, yay utilizes the AUR, which essentially serves as a Git repository for each package. These repositories typically include a PKGBUILD file and a .SRCINFO file, along with possible additional files like patches, desktop, or service files.
For example, take a look at IntelliJ Ultimate: [aur.archlinux.org/cgit/aur.git/tree/?h=intellij-i…]. It contains the .SRCINFO and PKGBUILD, as well as a .desktop file. These files themselves do not occupy much space.
The PKGBUILD specifies the sources for dependencies. For instance:
source=("https://download.jetbrains.com/idea/ideaIU-$pkgver.tar.gz" "jetbrains-idea.desktop")The PKGBUILD is essentially a Bash script with predefined functions and variables. You can learn more about it here: [wiki.archlinux.org/title/PKGBUILD].
This script primarily downloads and extracts the tar file. In this specific case, it only relocates the files to their intended installation locations, like moving the desktop file to /usr/share/applications.
With such packages, there’s a possibility of wasting significant space since the tar file is downloaded and possibly retained in the cache.
However, other packages, especially those compiled from source, usually involve Git clones. These clones bring the Git repository into a subdirectory of the already cloned AUR package Git repo. Some might also have source tarballs. These types of packages generally do not consume much space in the cache, as they are often just text files, like C source code or Python scripts. These packages frequently rely on external libraries and packages, which are not included in this package’s cache.
While binary packages often bundle all necessary libraries and other components in their source tarballs.
The AUR cache is mostly beneficial if you’re rebuilding the same version or can reuse components from a previous version. For example, a package might depend on a large, static file that doesn’t change often.
In Paru, I’ve enabled the “CleanAfter” option to prevent my cache from overflowing. Given my relatively fast internet speed, redownloading large files isn’t a major concern for me.
Haven’t deleted it yet actually, looks like most of it is from yay
Don’t. You don’t need to clean it unless cache of some buggy program grows uncontrollable.
Just mount it into your RAM
This particular folder caches many things from various package managers. Won’t hurt to clear, but will fill up again. Maybe consider not using caches when engaging such things.
How?
Depends on the package manager. Check options for whatever you’re running.
Can hurt to clear, there’s a lot more than just package managers using it
It’s a cache folder. Created by the distro. They labelled it as such because it’s cache, and can be considered ephemeral. It won’t do any permanent damage to anything unless you’ve accidentally been using it for something else.
Package managers don’t use this directory as well as any other subdirectory of user’s home.
Could have fooled me, because it’s certainly the default for things like brew, flatpak, mpm, and pip. Looks like npm and maven use it on certain Debian based distros as well. I’m betting more of the immutable distros use that directory as well vs something in /var/cache.
Ah, sorry, I thought about system package managers like apt, dnf, zypper etc.
That’s not very cache money of you
This is one of those things that makes me shake my head about Linux. It’s these small dumb problems that make Linux inaccessible to the common person.
Not really. I’ve never seen .cache get bigger than 10GB, which is about how big the temporary files in Windows get if you never clean them.
.
It ended up being yay storing binaries from previous versions of AUR packages, definitely depends on the distro/usage but for arch-based it definitely clears up a lot of storage
.
I’ve never seen any of my ~/.cache directories get more than a few GB either and I never bother to clean them.
I am curious what OP was doing that used that much space though. That’s certainly not typical.
It was AUR packages from yay. I’m a CS major into gaming and emulation so there are a decent amount of programming build tools from the aur that I had, it looks like most of it is coming from storing all of the binaries from AUR packages, as intelliJ ultimate takes up 50 GiB, proton-ge-custom takes up 31 GiB, and Yuzu emulator takes up 16 GiB.
I get the same all the time. OP reminded me to check today and Jetbrains toolbox had cached a lot of downloads that took up 42 GB in total. yarn folder with 2.3 GB. bazel folder with 15 GB (apparently used for building Anki),7 GB paru clones.
All in all it added up to 82 GB.
Yes because other operating systems never have any small annoying issues.
They do have small annoying issues. This is not one of them. This is something that would completely baffle a non-tech literate person. They’d just observe their computer becoming slow or not having space and say “well, Linux must have broken my computer.”
Have you checked your C:\windows\temp folder lately?
Oh yeah, you never hear such complaints about Windows or MacOS.
BTW can you recommend any good tools to cleanup my registry?
And don’t forget to defrag, while you are at it.
Windows auto defrag now though. Dont hate me I love my Linux.
FYI, Windows doesn’t have any feature either to automatically clear all of it’s temp folders (%TMP%, C:\Windows\Temp, C:\Windows\Panther), plus several other folders where orphaned files are often leftover, such as C:\Windows\Installer, C:\Windows\CSC, and various folders and cache files in your AppData\Local etc, to name a few off the top of my head.
I used to be a Windows sysadmin for a long time, and let me tell you, HDDs becoming completely full due to cache/temp files is very much a problem in Windows.
This has not been the case since at least w10, it has a tool to automatically clean several temp files and recycle bin.
If you’re talking about the Storage Sense feature - it sucks. It only clears a handful of well-known locations, but it doesn’t touch any of the orphaned content in C:\Windows\Installer, or the CSC or the old Panther folders from upgrades, not to mention several other files and folders in AppData. As I’ve said before, I’ve been a Windows sysadmin (until last year infact) managing over 20,000 devices, we’ve had Storage Sense on, but it’s been mostly useless - to the point that I ended up writing own cleanup script and set it to run before we pushed out a new Windows feature update, because otherwise we’d get several devices which failed to update due to the disk being full.
I think it's that one. I certainly won't say it's a panacea, but I assume it would have solved the OP's case.
Guess what I found in
/home/{user}/.wine/drive_c/users/{user}/Temp, 10GB of log files. Although 9GB was from one time when I used Cheat Engine and I don’t know what really happened tbh besides it causing a OOM crash.It created a 9GB sized file called
ADDRESSES.TMP, I never considered checking for temp files in .wine before. And I guess I should be checking all the prefixes created by Steam games as well…I once had a huge 20ish GB file in windows I could not get rid of, move, or delete. It was related to hibernation or something like that… Even though I had hibernation disabled and no amount of googling could get rid of the file.
This is something that would completely baffle a non-tech literate person. They’d just observe their computer becoming slow or not having space and say “well, my computer just broke itself better throw it in the trash and get a new one”
I’ve seen similar issues in appdata on windows when a program is poorly configured and simply grow its logs to ridiculous sizes. It’s an issue with a program utilising that folder, not the os.
The hate you’re getting for this is so revealing and depressing. It basically proves you right.
To the haters: where is the factual problem with this personal opinion? Have you considered making a counter-argument instead, instead of simply lashing out with the downvote button like spoiled infants? This kind of tribal pile-on really pisses me off. You are literally censoring an opinion expressed in good faith - downvotes hide comments and reduce reputation. All while offering no rebuttal, no ideas of your own, nothing. Nice work.
It is what it is. I’ve been involved in Linux communities long enough to know not to take stuff like this personally.
On Reddit we saw constant posts about why Linux isn’t more popular but no one ever talks about all the dumb little issues that the distros have because of a slight lack of polish. Those little issues make the distros seem cheap compared to the polish of something like Windows.
I’m always amused at the replies I get with things like “When I had Windows it literally caused my CPU to burst in to flames and my SSD shot my dog. Now I’m running Arch and it showed me last night’s winning lotto numbers.”
Ha! Yes I agree completely with all of that.
And with your point here. In this world of pocket touchscreens and voice AIs, where young people don’t even know what a file is any more, the geeks here are reminding each other to empty their .cache directory from time to time. I mean, do they have no self-awareness? Or perhaps they simply don’t care if nobody chooses to use Linux. That at least would be coherent, but if there are no new users then eventually the whole thing will just die.
IMO I’d say the same thing about windows’s “Temp” folder though.
I agree that a lot of Linux isn’t user friendly but I’m also on a distro that is specifically supposed to be customized from the ground up (arch-based) using a tiling window manager which also involves configuring most things from the ground up. This isn’t a problem that most Linux users will likely have, but it is a problem that people may have if they are power users trying to have full control over their system (people who will be on a community about Linux). From what others in this thread have been saying, non-arch distros (and even arch with other aur helpers than yay) tend to have much smaller caches that get up to around 10Gb at most, which is also similar in size to what Windows’s temp directory uses.
This is a Linux community on a FOSS platform. This community is inherently going to be filled with more “geeky” people. Isn’t this what we signed up for? You make it seem like Linux was ever attracting people who weren’t these type of people to begin with. Computer science is still a growing field, and most sane computer science curriculums involve using POSIX terminal commands and by extension linux at some point. I’m a zoomer and can confirm, we’re not all as hopeless as you think we are. Linux will be fine even ignoring all of its corporate and government backing. And for people who don’t even know what a file is, they probably won’t know what Linux is in the first place. Even if they somehow have a system preconfigured with linux, their Ubuntu or Linux Mint install will probably be clearing the cache for them.
Some good points here, I stand partially corrected.
There are in fact 2 completely separate things that irk me. The biggest is the virtual lynching that is mass-downvoting. I’m sorry, I will never ever pardon the downvoting of opinions, I think it’s the illness of the social internet since the very beginning. See my many other recent comments for evidence of how strongly I feel about this.
The other issue is the actual one at hand! You’re right that this cache folder business does not really concern most ordinary users, even on Ubuntu. But actually, if even we geeks need to tell each other to “remember to do X every now and then”, I have enough of an IT mind to think “Why do we need to remember anything?! The tool should do this job for us!” These are “babysitting” chores and IMO on a decent OS there should be zero babysitting, it should be set up once and then it should work forever, with any tweaking optional.
Not a “hater” in terms of trying/wanting to be mean, but I do disagree. I think a lot of people downvoting are frustrated because this attitude takes an issue in one application (yay), for one distro, and says “this is why Linux sucks / can’t be used by normies”. Clearly that’s not true of this specific instance, especially given that yay is basically a developer tool. At best, “this is why yay sucks”. (yay is an AUR helper - a tool to help you compile and install software that’s completely unvetted - see the big red banner. Using the AUR is definitely one of those things that puts you well outside the realm of the “common person” already.)
Maybe the more charitable interpretation is “these kinds of issues are what common users face”, and that’s a better argument (setting aside the fact that this specific instance isn’t really part of that group). I think most people agree that there are stumbling blocks, and they want things to be easier for new users. But doom-y language like this, without concrete steps or ideas, doesn’t feel particularly helpful. And it can be frustrating – thus the downvotes.
Fair enough, tho personally I don’t see this “doom-y language” you see, I just see a slightly exasperated opinion expressed in good grammar and good faith.
But personally I don’t downvote people for their opinions, ever, as a matter of principle. It’s literally a form of censorship, given that it hides the comments. It leads straight to a deadening groupthink where dissenters are scared to open their virtual mouths. It creates a general aura of negativity and intolerance that helps nobody at all. Downvoting, as it is used by most people here and on the R-site, is an absolute scourge. If anything makes me leave this community, it will be this.
Well, they're an Arch Linux user which is a special case. On Arch and derivatives it's the user's responsibility to manage the system so this doesn't happen, configure cleanup daemons, flush package managers, etc., alternatively it could also be a misbehaving application which would have to be reported. Arch is for hobbyists who likes to do this.
On other Linux distributions, Windows or macOS if this happens it's usually an application not properly managing its cache.
I’ve been running Linux as my primary OS since the late 90s and have never run into this problem.
I don’t think I’ve ever seen .cache get bigger than 10GB
Depends on the distributions and default settings. In arch, by default, pacman doesn’t delete cache.
Pacman’s cache isn’t in ~/.cache though, it’s in /var/cache. So whatever is taking up this much space isn’t the package manager.
That being said, I think the arch devs should add a config option to automatically delete old packages without having to run paccache manually and have it default to the last 2 versions of a package or so. It can grow quite big over time.
You can set a hook to do it automatically or use this, but I agree that this should be default behaviour
You can also just do
systemctl enable paccache.timerto automatically run paccache once a week.It looks like yay was storing AUR build files there, that folder took up about 160 of the 164GiB
You can use
yay -Scto clean the cache. It’ll also ask you if you want to clean the pacman cache, which I’m assuming you also haven’t cleaned (check the size of/var/cache/pacman).One would just need to modify the pacman cache hook for yay. I’m too lazy tho.
If it is true, it is a bug in yay. Cashe should not grow without limit.
It was reported twice as minimum. Seems that author does not care.
Shouldn’t it store that stuff in data-home or state-home? Pikaur compiles in cache and stores it in data-home after.
You should try using paru, might be better off with it.
Paru cache is huge and you have to delete it manually with something like paru -Sc i think
My update script handles mirrors, updates and cleans the cache automatically. I’d definitely recommend creating one. It’s aliased to sysupdate for me and I also check if it’s a debian or arch based distro so the command works on my servers and desktop
What is your update script? Where did you post it?
I don’t think I’ve posted it before, but here it is. If you use different utilities you’d have to swap those out. Also excuse the comments, I had GH Copilot generate this script
I highly recommend topgrade. You can add custom commands so clearing paru’s cache shouldn’t be a problem. I just do it by hand as I’m ok with it.
I’ve heard of tools like that, but this works fine for me. This way I’m not dependent on it being packaged for my distro and having to install it through other means. I’m fine running things manually, this is just for convenience
it doesn’t matter if you use paru, yay or heck makepkg if you are compiling packages with hilariously large sources like for example webbrowser (librewolf, brave, ungoogled-chromium, firedragon take each like ~30 GB) without pruning the build cache afterwards
Something I noticed was that in this case it was mostly binary AUR programs taking up the space.
I think maybe since yay/AUR use cloned git repos, and old versions of binaries get stored in the git diff and then add up because different versions of the binary are basically like keeping multiple copies of it instead of just the changes to the source code.
Doesn’t Steam store the game library there?
No, .cache is similar to a temporary directory (or at least in theory) where important data isn’t supposed to be stored there, instead only temporary files that might speed things up (e.g. images in a browser or thumbnails in a file manager). In this case it looks like all of my AUR packages had their source files cached, which added up over the ~1.75 years that I’ve been running this distro
Yep my bad! I mis-remembered .local/share/steam as . cache/share/steam. :)
it stores it in ~/.steam
Ah I was getting it confused. At one point Steam stored everything in ~/.local/share/steam and symlinked ~/.steam to it. Doesn’t appear to be the case on Ubuntu 22.04, though I used to use Debian and grab the .deb from Valve’s website. My bad! :)
I did this and now my games have no icons in lutris, some of my gnome settings got reset and my proton email bridge stopped working
You shouldn’t have done that Dave.
Time to write some bug reports. ~/.cache is supposed to be disposable.
So the apps are broken. Cache is meant to be deleted at any time
not necessarily during runtime
But a restart of an app should fix it.
For some reason devs can’t wrap their head around cache being temporary.
Cannot this be caused by deleting the folder and not just everything inside?
It’s likely. mkdir fails to create a subdirectory such as ~/.cache/mozilla/ if ~/.cache/ doesn’t exist, unless
-pis explicitly passed to mkdirOf course, not everything is a shell script, but I imagine the directory creation functions in many languages work similarly
The contents were deleted
Because of excessive RAM I symlink
~/.cacheto/tmp. Additionally installingzramswaphelps for this scenario.Benefits are faster access, automatc purging between reboots and no wear to the NMVe drive.
Yes, this is a single user scenario.
Isn’t most of what’s in there just filters downloaded from the internet? Python packages, browser cache, etc? Your system confirms you to redownloading everything all the time, no?
Once I get more than 16GB of ram I’ll definitely try that
This seems like a filename conflict waiting to happen. Why not just mount a tmpfs there?
Like I said it’s a cheap solution for a single user system. Ofc tmpfs would be better but has to be done for every user again
You: It’s a single user system
Also you: Tmpfs would have to be done for every user
And a /tmp/ symlink would have to be created for every user too, so I don’t get your point
Tmpfs is just as easy as making a symlink, but without the filename conflicts between files in ~/.config/ and /tmp/. You just need to add a line to /etc/fstab
/usr/local/sbin/adduser.local
One line in there and you can make it add a new line with appropriate /home/userX/.cache tmpfs line to fstab.
Or, maybe a cleaner way, you might make a init/systemd service that, when booting, would run something like
for each dir in /home do
mount dir/.tmp -type tmpfs
done
I’m not at the computer now and I’m lazy to Google it, so this above is just a pseudo code and probably won’t run.
Neat, thanks for sharing
Here’s the above pseudocode in bash:
find /home/ -mindepth 1 -maxdepth 1 -type d -exec mount none {}/.cache/ -t tmpfs -o size=16G \;fordoesn’t work here because it uses spaces to delimit strings, which could cause issues with filenames that contain spacesYou can also create a systemd user service, which is useful if you don’t have root access. The above mount command requires root, but the following doesn’t and is more robust than symlinking to /tmp/:
Thats not very secure. /tmp/ is usually 777
You don’t have to clean your ~/.cache every now and then. You have to figure out which program eats so much space there, ensure that it is not misconfigured and file a bugreport.
So OP’s headline should be saying instead:
Reminder to CHECK your ~/.cache folder every now and thenCheck? Why?
I don’t remember if I ever cleaned it up. Probably a couple years ago when I moved my old HDD to new PC with freshly installed OS. It does not grow accidentally. Only in some very rare cases. As well as some other dirs under
~andvar. If it is a critical system, set up monitoring of free filesystem space. If not, you will notice if it becomes full (I can’t remember when this happened to me last time, maybe ~15 years ago when some log file started to grow because of endless error messages).Because some users experienced accidential grows like OP had 160 Gbyte. So general advice for linux users can be stated as: Check your ~/.cache every now and then
Critical systems/servers shall better be monitored as you suggest.
Some users experienced accidential growth of /var/log. Some users experienced accidential growth of /var/cache. Some users experienced accidential growth of /var/lib. Some users experienced accidential growth of ~/.xsession-errors. Shall I continue?
Does every user need to begin his day checking all that places? No, he does not. It is waste of time. Such situations are extremely rare. If you are paranoid, check
dfto see if you have enough free space, and only if it unpredictably shrinked begin to ivestigate which directory has grown.I don’t get your point. Why should somebody do this every day?
As the experience from other users in this thread, it seems not extremely rare to have an overgrown ~/.cache/ folder. So checking it from time to time is a good advice. If we all do this for a time, and create bug tickets for software which is not cleaning up. Then this problem will hopefully go away with future software releases.
Why should somebody do this ever?
It is the first thread about overgrown
~/.cachedirectory I see since I use Linux (~16 years or so). But, as I wrote above, this sometimes (rarely) happens with log files and some other directories. Checking each of them is a waste of time, if not automated, checking just one or few of them makes sense only if you are testing some app and looking for files it creates.just symlink ~/.cache to /dev/null
Cache exists for a reason, that sounds like itd break programs, a safer method is probably having it be a ramdisk
<img alt="" src="https://lemmy.world/pictrs/image/60d072c0-1957-4a87-a232-4c71d6c4ae91.webm">
Lmao some malicious ass advise here
No way. If i clean up my .cache directory my precious cached with sccache rust deps would be very upset. >:[
Even better: mount ~/.cache as ramfs. It will also speed up some apps significantly.
I always felt that there should be some user directory like
/tmp/which will be wiped regularly./run/ contains such a directory
/tmp and /var/tmp are writable to regular users on most distributions
This is why Linux sucks!
That’s nice
Windows famously never generates any garbage files. It’s so reliable all servers run windows. Right?
Like the kernel itself sucks or a specific distro sucks?
ALL OF IT
Shotgun approach I see.
Don’t feed the trolls.
Check which folder is the biggest. I am going to go on a lim and say it probably is being caused by file roller
It’s yay, which took up ~160 GiB. It was storing previous versions of AUR binaries which I guess added up over time. I posted a screenshot of ncdu outputs for a more detailed breakdown in one of the other reply threads
Is probably a better command in this instance
Honestly the reason I’ve put yay/paru’s build directory into ram/tmpfs long ago. It’s almost never worth it keeping all those packages checked out. You also do your ssd a favour by not hammering it with compile workloads.
Bleachbit is good for clearing up some space
And deleting emails
Even Hillery knows that one.
Come on!
/s
…yeah let me go check that…
13,574 totaling 1.7gb, not too bad. Hey OP how do you get to this view? It looks like we both use nautilus but when I select “properties” on the .cache folder it looks different.
the screenshot does not look like nautilus, maybe xfce?
I use thunar (with ePapirus-Dark icons which is probably what makes it look like nautilus), I liked nautilus when I used it but thunar has a bit more functionality that I like
Ah thanks!
Is it safe to clear
~/.cache/mozilla/while Firefox is running?No.
Maybe not while it’s running, but .cache is intended to be temporary files only so expecting files to permanently be there should be treated as a bug
Your Distro should normally do that for you.
Advising for this means people will delete random cache and download stuff always.
Are multiple files in there? If yes you could add a script that only deletes files of certain age.
I’m not aware of any distro that automatically clears a user’s .cache in their home directories. Maybe you’re thinking of /var/cache?
.
I just map both the user cache and the /tmp directory to a RAM drive. I allocated 4 GB but in practice it never gets even close to that much, and Linux seems to not be reserving the entire 4 GB at boot so I would assume how much RAM is used depends on how much is actually in your cache.
It also defers cache and tempfile related problems to turning it off and on again.
seems like a bug in one of rhe programs you’re using.
modt software automatically manages it’s cache…
are you using build caching tools such as Mozilla sccache? These tend to create 20gb+ cache directories, especially if used with debug builds
$ crontab -e
.
I guess you could also Mount a tmpfs to that directory
NEVER
<img alt="" src="https://lemmy.zip/pictrs/image/d48cb113-84c0-44e1-ae7d-7bb23f172fcf.webp">
du -sh ~/.cache/* | sort -h