Sixtyforce@sh.itjust.works
on 01 May 02:46
collapse
IpFS like ddh says makes the most sense probably. But you can archive a lot of raw text. Try to save what you think the Nazis would burn. I doubt archive.org survives many more years.
Leaked archives of american research papers too.
Someonelol@lemmy.dbzer0.com
on 30 Apr 19:50
nextcollapse
Watched it for the first time last year. It was incredible. Absolutely holds up to modern stuffā¦ Except for some absolute creep moments around Bulma, various sexismā¦ The overall purity culture weirdnessā¦ Some really homophobic thingsā¦ Some really racist thingsā¦ ā¦
Okay. It has issues. Lots of really big issues. But the music is amazingly fresh and the visuals top notch and itās always entertaining, minus the glaring problems. And that they did Lunch so dirty for some reason.
Sixtyforce@sh.itjust.works
on 01 May 12:53
collapse
Thatās still modern Japan lol. At least, it stands out to me vs western media today.
Thatās a pity they havenāt changed. I know a lot of Japan has gotten better, but I also know that they still have a prevailing homophobic purity culture.
Rant:
One of my favorite animes is one piece, and as much as I love it for it and some personal connections in my head around it, thereās just so much hurtful and thoughtless stuff in it.
Generally, Oda does a good job of keeping it harmless and goofy, even when using racist or sexist or homophobic tropes. He generally keeps them colorful and just for the sake of having weird shit. Which I have always loved.
Butā¦ Every once in a while thereās like an ice cold bat to the face, be it something that is just old (Iām rewatching it) and at the time may have been trying to bridge an acceptance gap, or just downright mean spirited.
Like for example, Iām in the whitebeard war area of the story, and thereās the crossdresser stuff and the king(queen?) of them. Fat, Giant Head, lingerie all the time even outside, giant chin and jawline, crazy makeup, and when he attacks, he winks at you. Like. Come on. Thatās so shitty. And I would say that the character is a drag queen, but he LITERALLY USES HORMONES TO CHANGE HIS AND OTHERāS PHYSIOLOGY. Like a military guard is about to attack him, and he injects him with hormones and turns the guard into a woman, who then gets embarrassed, mews, and collapses in heat and embarrassment. Heās not a drag queen, theyāre a transgender non binary, genderfluid troll that everybody calls an okama, which, to my knowledge, is basically a sissy or maybe even a slur, >!faggot or fag!<.
And all the hyper stylized femininity toothpick waist girls and barrel shaped boys. Like come on, if youāre gonna do that style, give me those waify boys, tough girls, and sexy and confusing enbies at least.
All the people in queer land are just manly crossdressers. Where are the femboys!? Where are the gorgeous women who just happen to be assigned male at birth?
Maybe one piece gets better over time. Maybe there are anime that are better. Maybe thereās āWesternā media today thatās more realistic.
/Rant
gravitas_deficiency@sh.itjust.works
on 01 May 03:06
collapse
Holy shit, youāve nearly 20xād me š«”
Saik0Shinigami@lemmy.saik0.com
on 01 May 03:15
collapse
Check againā¦
Thatās āfree spaceā. The 414 represents ~62% of my space (38% used). Iām at just under 700 for usable space. And 2 disks are out of the array at the moment because the backplane went stupid. Turns out that itās a pain in the ass to open server chassis to replace a backplane when you have to unmount 70 disks. And Iām pretty lazy.
gravitas_deficiency@sh.itjust.works
on 01 May 03:18
collapse
lol yeah - I revised my comment from 10x to 20x after looking closer. You literally 20xād me lol.
That is some thicc storage. Respect.
Saik0Shinigami@lemmy.saik0.com
on 01 May 03:39
collapse
Letās just say that I do my part seeding Linux ISOs.
~72 TB uploaded the past 30 days.
I am unfortunately the epitome of a data hoarder. I still have files that I generated/created 30 years agoā¦
gravitas_deficiency@sh.itjust.works
on 01 May 03:43
collapse
Damn, what sort of connection are you running? I feel like youād be getting throttled, assuming throttling isnāt strictly illegal (side note: genuinely, thank you, Peopleās Republic of Massachusetts ā¤ļø)
Saik0Shinigami@lemmy.saik0.com
on 01 May 03:52
collapse
Fiber, 8gbps through Quantum Fiber (part of the Lumen/Centurylink family). No throttling hereā¦
My bottleneck is the vpn that I have to have between me and the worldā¦ unfortunately. I only trust specific private trackers to not use it. I actually setup 4 seed boxes (VMs) in my garage to push more data out.
SCmSTR@lemmy.blahaj.zone
on 01 May 08:54
nextcollapse
Probably years of passion. Possibly a career related to this stuff.
gravitas_deficiency@sh.itjust.works
on 01 May 12:13
collapse
Iām gonna guess incremental increases over the years, and snapping up used enterprise stuff on fire sale. Itās actually pretty feasible to do if you know where to look for this stuff.
Saik0Shinigami@lemmy.saik0.com
on 01 May 13:15
collapse
More or less exactly this. Most of my servers are company decommission (some companies have a strict upgrade cycle, and I even have like 3 more āsparesā sitting around). Iāve found some government liquidation here and there as well which has been great for resale to recoup some of what I spend. I have something like 4TB of Ram sitting in a box somewhere that I should sell somewhereā¦
Some stuff was ādecentā ebay buys. A few items I just had to pony up for. Battery backups was mostly paid at full msrp, but has been worth it. HDDs are mostly ārefurbā and built up over time as well, which is why raidz2 and several spares in the zfs pool.
But yeah, about 10 years of building it up. I use it as my playground for professional development, and itās helped prove a lot of what I say on my resume.
When you have a functional setup like this, and can show that to potential employer. Itās been the best sole investment Iāve ever made. Itās netted me more money in contracts by many many times what I put into it.
Edit: and saved me from countless ācloudā privacy violations, data breaches, etcā¦
Edit2: Recurring costs is basically energy. The rack itself uses about 90kWh a day (about $5/day for me), cooling and all. My solar install creates just about that much per day as well so thatās all offset (and if I ever move my equipment into a colo, my house will basically have no electric bill at all). Internet is $165 a month, which is fucking great IMOā¦ VPN is paid every 3 years or whatever that cycle is on. If I was to just take the non-replaceable stuff (about 20tb worth of data at last check, and a bunch of lxc containers) and put that on a VPS somewhere Iād be paying at least 10x what I do now in someone elseās datacenter, forget that thatās a recurring monthly cost.
Edit3: Just because it is likely useful information for SOMEONE out thereā¦ If you know that your setup takes 10kWh a day, you need to account for another %50 for cooling, so you should actually expect 15kWh in that usecase. My actual rack uses ~60ā¦ 30 more is cooling. I actually have all my power usages broken out in a sankey graphā¦ Even goes further to break it down on a per server usage as well, but I canāt take a reasonable screenshot that doesnāt show personal information. This is 24 hours of usage (specifically 04/30, yesterday) and āgarage dedicatedā is what the A/C unit I have in the bottom of my rack is plugged into.
Iām in an apartment currently; the footprint Iām willing to allocate to a server amounts to a full-size ATX case, and a bunch of small ebayād lenovo thin clients (plus a handful of rPiās and similar SBCs). When I finally am able to get a house with some actual project space, I aspire to build something approaching your setup over time.
Saik0Shinigami@lemmy.saik0.com
on 01 May 14:03
collapse
I started on cluster (8) of rpi3b and a Synology NAS 10 years agoā¦ prior to that was just storing it all on random hdd (harddrive toaster was alway present and loaded on my desk) and on my computer. these days you can get those little intel n100 or n150 boxes for pretty cheap too. Thereās a lot of options, and a lot of mature software tech to make it all work well together.
Sixtyforce@sh.itjust.works
on 02 May 01:07
collapse
Itās been enough to just seed behind a VPN at this scale? Iād like to do something similar one day at smaller scale but Iām a bit fearful.
In my youth I used to operate my own and admin on other ROM sites. The smart move then was Asian server hosts who would take anonymous payments with no personal info attached to the accounts. But we were still worried of Nintendo, keeping safe was a bit scary.
But they never went after us. It was easier for them to just go after people hosting in the USA under their real names.
But thatās centralized, different ballpark from p2p. I used to use mullvad for torrents until they removed port forwarding.
Saik0Shinigami@lemmy.saik0.com
on 02 May 01:15
collapse
Itās been enough to just seed behind a VPN at this scale?
I think that question really hinges on āwhat vpn provider you choose to useā. Honestlyā¦ People donāt hit me as hard as I wish they would.
~72 TB uploaded the past 30 days.
From earlier. ~64TB of that is on my VPNād hosts. I know itās a bottleneck by itās very natureā¦ the highest Iāve seen all 4 peak at the same time was just over 3gbps aggregateā¦
The VPN I use is a no log vpnā¦ and I choose an exit point thatās outside of my country. So at the very least would require coordination between 2 countries, and a provider that has nothing to give upā¦
At that point itās all about the trackers that youāre a part of.
Sixtyforce@sh.itjust.works
on 02 May 02:56
collapse
Cool thanks for info.
SCmSTR@lemmy.blahaj.zone
on 01 May 08:53
nextcollapse
Jfc please make sure thatās hazard proof and donāt get raided. People like you legitimately make the world go round.
Saik0Shinigami@lemmy.saik0.com
on 01 May 13:22
collapse
So about thatā¦ I actually got solar installed on my house and when the āelectricianā (subbed out contractor with dubious credentials but was operating under a legit company) ran dedicated breakers for the serversā¦ the junction box caught fire.
That was a fun 2am to wake up at.
But itās pretty safe now. Have had several master electricians come in and evaluate it all at this point and all of them are happy with it now.
What about things like earthquakes, house fire, flood, volcano, tornado, hurricane, crashing plane, theft, nazis, shitty kids, anarchists, or rain?
Saik0Shinigami@lemmy.saik0.com
on 01 May 19:54
collapse
earthquakes,
I live in a geo-stable locationā¦ Lots of DCs here specifically because of that.
house fire,
Yep. Fire extinguishers are in house, and I check them pretty regularlyā¦ Blaze cut is in the junction box(now) and in the rack. Rack is in garage, so I can just unplug and push it the fuck out (assuming I have time after throwing my kids out the windows).
It was actually my setup that alerted me to the junction fire pre-emptivelyā¦ as power usage was fluctuating wildly and I have Home Assistant alert on that sort of stuff. It only sparked and blew some insulationā¦ The fire didnāt actually move anywhere meaningful and I cut power before it had a chance to get worse. My fire alarm itself is also tied into HASS at this point. So I get alerts on my phone for the rare occasion that I leave my house (most [99%] of my work is work from home, I go to a datacenter probably quarterly at this point for all of an hour).
flood,
We barely get rain :(. But because of the soil here thereās lots of washes and irrigation mitigations in place already.
volcano,
Yellowstone finally going up will just outright kill meā¦ donāt care to mitigate this at that point. Thereās no other active volcanos around.
tornado, hurricane,
Doesnāt happen here. Dust devils are about as bad as it gets.
crashing plane,
So thereās 2 ways to look at this oneā¦ I live near an AirForce base. Either they fuck up and Iām more at riskā¦ or because the area around the base is no-fly zone, Iām less likelyā¦ I donāt know take your pick. I would hope āless likelyā due to trainingā¦ but Iāve seen stupid shit when I was in the military.
theft, nazis, shitty kids, anarchists,
Gunsā¦I have guns. Lots of ammo. A good setup for cameras on my house. And no fucks to give as army training and a deployment has forced onto me. My state is a stand your ground state. If itās my kids that are the shitty kidsā¦ I have a backyard and a shovel (/s).
or rain?
See āfloodā above.
Other sources of water (water leak): no pipes above the server rackā¦ Water heater isnāt that close, has a freezer in between to take the brunt of any initial impact, and is brand new (so unlikely to spontaneously explode). Rack is elevated on itās coasters and garage is graded towards the street.
We can get some interesting thunder storms here. Rack is grounded, I have backup batteries in the rack and whole house battery from the solar. But luck be what it is, in theory that could nail me as unlikely as it is.
Everything is encrypted at restā¦ Backups are encrypted.
I donāt have a proepr offsite yet. But my cousin is finishing building his house. He also has a fat internet pipe, and Iāll just leave a 25TB node there to backup the important/unreplaceable stuff over there. Heās clear across the country in a pretty geo-stable location as well. And he has an interest in maintaining it as he uses some services that I offer anyway (Email, nextcloud, backups, etcā¦). Everything else is pretty replaceable and wouldnāt take all that much effort to rebuild otherwise.
Never claimed I was āperfectāā¦ But Iām doing pretty well here and have been doing it for nearly a decade this way. With ~30 years worth of data and very little of it lost. (there was one event over a decade ago at this pointā¦ but wasnāt all that bad.)
The real risk is just me doing something stupid since Iām the sole owner and nobody else really knows how to access any of my stuff. My dad has emergency access to my password vault, but even though heās been programming since the 80ās, a lot of my setup is likely over his head.
All this other stuff is pretty low risk/unlikely or has been relatively decently mitigated.
Edit: Ohā¦ and some certain important items are burned to M-discs and put into my safe every quarter or so.
gravitas_deficiency@sh.itjust.works
on 01 May 12:12
collapse
Nyticus@kbin.melroy.org
on 30 Apr 16:31
nextcollapse
The day the Internet Archive was being attacked and sued, was the signal.
Imgonnatrythis@sh.itjust.works
on 30 Apr 17:07
nextcollapse
They donāt have to participate, but itās a good article to raise awareness for your non tech oriented friends and family.
This is a massive problem, but at the very least itās happening in an era of very cheap data storage.
corsicanguppy@lemmy.ca
on 30 Apr 18:43
nextcollapse
I stopped reading at āliterallyā, which was early-on.
GreenKnight23@lemmy.world
on 01 May 00:57
collapse
did you literally or figuratively stop reading though?
atomicbocks@sh.itjust.works
on 30 Apr 19:16
nextcollapse
Lots of people hoard data. The problem is keeping it in a working state. Think about how many people have old towers or laptops in their garage or basement never to look at those downloads or vacation photos again.
Iām a huge fan of the golden era of anime fansubs. I know a lot of people still have the files, but theyāre probably squirreled away on an offline hdd or a bunch of dvds, not being shared. Itās quite sad and frustrating. Itās completely lost culture in many instances.
pulido@lemmings.world
on 30 Apr 22:42
nextcollapse
I agree. I recommend most people donāt go overboard, but they can still do their part.
Save the things you like and are relevant to you. Movies, shows, games, music, books, etc. You donāt have to be an archivist. Storing data should be something that reflects you, personally, and it should genuinely be more enjoyable as a result.
It should feel good to preserve and be responsible for another copy of the information you like.
GreenKnight23@lemmy.world
on 01 May 00:56
nextcollapse
3tb of porn and growing.
momma always said, ādo what you like you thick sumbitch, yer gon do it anyway.ā
Be glad you donāt have VR. Those porn vids get big.
forgotaboutlaye@lemmy.world
on 01 May 07:15
nextcollapse
Music is a no brainer for me since itās something that is infinitely re-enjoyable (if thatās a word) and it doesnāt have to take up much space, without reasonable compromises to quality.
I bought a digital audio player last year so that I could be offline and disconnected when I go out but still enjoy music. One of my favourite purchases the last few years.
Gradually_Adjusting@lemmy.world
on 01 May 14:58
collapse
And seed the hell out of it! š¦
ultrafastsloth@lemmy.world
on 01 May 07:37
nextcollapse
I donāt know who here likes Horizon games, but I like how many parallels the writers put in the game that reflect the state of the world.
::: spoilerĀ a bit of a game spoiler
Like the whole premise of the story is exactly what this article mentioned: a multi billionaire CEO with a god complex completely wiped out the entire human database to erase any information of how he destroyed the world to protect his ego and image. Also why the new world is basically just bronze age level tribes.
:::
TriflingToad@sh.itjust.works
on 01 May 14:40
nextcollapse
my coolest data hoard (im not insane, I only have like 3tb, mostly of games) was the doom 1993 files.
me at 2am tinkering with my computer had an emotional connection to another computer nerd back in 1995 at like 11:30 at night who was packaging doom files that through dozens of exchanges made itās hands to mine.
i have like 10 tb of documented changes from just the us govnt websites. I log every. single. change. to a selection of both local and federal .gov sites. Ive got a pi, whos only job is to find and log this. I figure this kinda documentation could be historically significant if sombody tries to alter the past.
idk why I do this, I just like the info. I wanna build a website to display these changes.
ik the internet archives existā¦but what if somthing happens?
The oldest one I have is from 2007. Still works fine. As for how long they last it heavily depends on your luck. Iāve seen HDDās from the mid-nineties that still work, not in person just to clarify. I donāt have any irreplacable data stored on them. Itās also important to use a filesystem that can detect corruption like btrfs, becachefs, or zfs.
Picked up a 24tb external drive. My video collection and stuff is going onto it, so that I can nuke my PCās drives and start fresh. The odds of Microsoft being a Trump Regime collaborator are high, so I want to be ready to hop out of the frypan when the time comes.
Aside from that, I have been ripping and converting my discs again. AV1 offers nice space savings. Patlabor, OG Dragonball, documentaries, all will be updated.
threaded - newest
<img alt="" src="https://sh.itjust.works/pictrs/image/6798d630-e100-494b-93f0-906409ce1efe.gif">
48TB rust in raidz2 reporting in
<img alt="" src="https://media3.giphy.com/media/mtLv0WFFijhB3y1jJ1/giphy.gif?cid=6c09b9529feg2mtfpxf41uh35rqt4nr70hgs6lgsrc5rmv8d&ep=v1_internal_gif_by_id&rid=giphy.gif&ct=g"> 20gb strewn across 3 RAIDS, no idea what file system type they use.
<img alt="" src="https://sh.itjust.works/pictrs/image/b4df5807-f053-42a6-a43d-16983a7550f1.gif">
108TB SHR reporting in.
8TB reporting for duty. š«”š
Seriously though. Whatās the best help to lend out say 2tb?
Edit:This is a serious question.
I think it was annas archive that has a page for what data they need mirrored the most based on your storage space available. After looking into it.
A bunch of USB sticks and external drives turned on and checked from time to time with rare files I need.
Walking along I guess. Bringing some tea.
You can take a look at Interplanetary File System and see what data you want to mirror.
IpFS like ddh says makes the most sense probably. But you can archive a lot of raw text. Try to save what you think the Nazis would burn. I doubt archive.org survives many more years. Leaked archives of american research papers too.
14TB RAID1 setup reporting in.
324TB misc here for duty
<img alt="" src="https://lemmy.saik0.com/pictrs/image/4d3c5897-2475-482a-918b-4cd0699095b7.png">
<img alt="" src="https://sh.itjust.works/pictrs/image/520e7d4d-486b-4847-83f3-19fd20a3a250.jpeg">
Hehā¦ Iām actually rewatching Dragon Ball right now.
<img alt="" src="https://lemmy.saik0.com/pictrs/image/c318bc80-991d-4918-9f5c-c9c979b9503b.png">
Awesome! I like the original series best by a decent margin. Soooo good.
Watched it for the first time last year. It was incredible. Absolutely holds up to modern stuffā¦ Except for some absolute creep moments around Bulma, various sexismā¦ The overall purity culture weirdnessā¦ Some really homophobic thingsā¦ Some really racist thingsā¦ ā¦
Okay. It has issues. Lots of really big issues. But the music is amazingly fresh and the visuals top notch and itās always entertaining, minus the glaring problems. And that they did Lunch so dirty for some reason.
Thatās still modern Japan lol. At least, it stands out to me vs western media today.
Thatās a pity they havenāt changed. I know a lot of Japan has gotten better, but I also know that they still have a prevailing homophobic purity culture.
Rant:
One of my favorite animes is one piece, and as much as I love it for it and some personal connections in my head around it, thereās just so much hurtful and thoughtless stuff in it.
Generally, Oda does a good job of keeping it harmless and goofy, even when using racist or sexist or homophobic tropes. He generally keeps them colorful and just for the sake of having weird shit. Which I have always loved.
Butā¦ Every once in a while thereās like an ice cold bat to the face, be it something that is just old (Iām rewatching it) and at the time may have been trying to bridge an acceptance gap, or just downright mean spirited.
Like for example, Iām in the whitebeard war area of the story, and thereās the crossdresser stuff and the king(queen?) of them. Fat, Giant Head, lingerie all the time even outside, giant chin and jawline, crazy makeup, and when he attacks, he winks at you. Like. Come on. Thatās so shitty. And I would say that the character is a drag queen, but he LITERALLY USES HORMONES TO CHANGE HIS AND OTHERāS PHYSIOLOGY. Like a military guard is about to attack him, and he injects him with hormones and turns the guard into a woman, who then gets embarrassed, mews, and collapses in heat and embarrassment. Heās not a drag queen, theyāre a transgender non binary, genderfluid troll that everybody calls an okama, which, to my knowledge, is basically a sissy or maybe even a slur, >!faggot or fag!<.
And all the hyper stylized femininity toothpick waist girls and barrel shaped boys. Like come on, if youāre gonna do that style, give me those waify boys, tough girls, and sexy and confusing enbies at least.
All the people in queer land are just manly crossdressers. Where are the femboys!? Where are the gorgeous women who just happen to be assigned male at birth?
Maybe one piece gets better over time. Maybe there are anime that are better. Maybe thereās āWesternā media today thatās more realistic.
/Rant
Holy shit, youāve nearly 20xād me š«”
Check againā¦
Thatās āfree spaceā. The 414 represents ~62% of my space (38% used). Iām at just under 700 for usable space. And 2 disks are out of the array at the moment because the backplane went stupid. Turns out that itās a pain in the ass to open server chassis to replace a backplane when you have to unmount 70 disks. And Iām pretty lazy.
6 x RAIDZ2 | 10 wide | 14.55 TiB
873TiB raw.
960TB raw.
This graph might be betterā¦
<img alt="" src="https://lemmy.saik0.com/pictrs/image/136a3d35-a14e-4ac2-a867-d6c91d49dc1b.png">
lol yeah - I revised my comment from 10x to 20x after looking closer. You literally 20xād me lol.
That is some thicc storage. Respect.
Letās just say that I do my part seeding Linux ISOs.
~72 TB uploaded the past 30 days.
I am unfortunately the epitome of a data hoarder. I still have files that I generated/created 30 years agoā¦
Damn, what sort of connection are you running? I feel like youād be getting throttled, assuming throttling isnāt strictly illegal (side note: genuinely, thank you, Peopleās Republic of Massachusetts ā¤ļø)
Fiber, 8gbps through Quantum Fiber (part of the Lumen/Centurylink family). No throttling hereā¦
My bottleneck is the vpn that I have to have between me and the worldā¦ unfortunately. I only trust specific private trackers to not use it. I actually setup 4 seed boxes (VMs) in my garage to push more data out.
Proxmox clusterā¦ and big storage truenas node.
<img alt="" src="https://lemmy.saik0.com/pictrs/image/66fed9fa-4e4a-4212-af0c-6239dfdaccbb.png">
And a dirty amount of networkingā¦ big cables on the right is QSFP, 40gbps 2x in lagg per server.
<img alt="" src="https://lemmy.saik0.com/pictrs/image/27d6f993-25f3-4247-bd2f-80dec70468f4.png">
These pictures were just after a transplant to a new server rack. So everything is offā¦ but the blinkinā lights are real.
Edit: Didnāt turn off anything before I ran theseā¦
<img alt="" src="https://lemmy.saik0.com/pictrs/image/b963ac92-c0cb-4ed3-b133-5bd25d3f6d2d.png">
How do you afford all this?
Probably years of passion. Possibly a career related to this stuff.
Iām gonna guess incremental increases over the years, and snapping up used enterprise stuff on fire sale. Itās actually pretty feasible to do if you know where to look for this stuff.
More or less exactly this. Most of my servers are company decommission (some companies have a strict upgrade cycle, and I even have like 3 more āsparesā sitting around). Iāve found some government liquidation here and there as well which has been great for resale to recoup some of what I spend. I have something like 4TB of Ram sitting in a box somewhere that I should sell somewhereā¦
Some stuff was ādecentā ebay buys. A few items I just had to pony up for. Battery backups was mostly paid at full msrp, but has been worth it. HDDs are mostly ārefurbā and built up over time as well, which is why raidz2 and several spares in the zfs pool.
But yeah, about 10 years of building it up. I use it as my playground for professional development, and itās helped prove a lot of what I say on my resume.
When you have a functional setup like this, and can show that to potential employer. Itās been the best sole investment Iāve ever made. Itās netted me more money in contracts by many many times what I put into it.
Edit: and saved me from countless ācloudā privacy violations, data breaches, etcā¦
Edit2: Recurring costs is basically energy. The rack itself uses about 90kWh a day (about $5/day for me), cooling and all. My solar install creates just about that much per day as well so thatās all offset (and if I ever move my equipment into a colo, my house will basically have no electric bill at all). Internet is $165 a month, which is fucking great IMOā¦ VPN is paid every 3 years or whatever that cycle is on. If I was to just take the non-replaceable stuff (about 20tb worth of data at last check, and a bunch of lxc containers) and put that on a VPS somewhere Iād be paying at least 10x what I do now in someone elseās datacenter, forget that thatās a recurring monthly cost.
Edit3: Just because it is likely useful information for SOMEONE out thereā¦ If you know that your setup takes 10kWh a day, you need to account for another %50 for cooling, so you should actually expect 15kWh in that usecase. My actual rack uses ~60ā¦ 30 more is cooling. I actually have all my power usages broken out in a sankey graphā¦ Even goes further to break it down on a per server usage as well, but I canāt take a reasonable screenshot that doesnāt show personal information. This is 24 hours of usage (specifically 04/30, yesterday) and āgarage dedicatedā is what the A/C unit I have in the bottom of my rack is plugged into.
<img alt="" src="https://lemmy.saik0.com/pictrs/image/05cf73f2-f9d5-418a-9406-51c006a47aa7.png">
<img alt="" src="https://sh.itjust.works/pictrs/image/c4bf4b52-cda9-4b20-88b8-9f599d451797.gif">
Iām in an apartment currently; the footprint Iām willing to allocate to a server amounts to a full-size ATX case, and a bunch of small ebayād lenovo thin clients (plus a handful of rPiās and similar SBCs). When I finally am able to get a house with some actual project space, I aspire to build something approaching your setup over time.
I started on cluster (8) of rpi3b and a Synology NAS 10 years agoā¦ prior to that was just storing it all on random hdd (harddrive toaster was alway present and loaded on my desk) and on my computer. these days you can get those little intel n100 or n150 boxes for pretty cheap too. Thereās a lot of options, and a lot of mature software tech to make it all work well together.
Itās been enough to just seed behind a VPN at this scale? Iād like to do something similar one day at smaller scale but Iām a bit fearful.
In my youth I used to operate my own and admin on other ROM sites. The smart move then was Asian server hosts who would take anonymous payments with no personal info attached to the accounts. But we were still worried of Nintendo, keeping safe was a bit scary.
But they never went after us. It was easier for them to just go after people hosting in the USA under their real names.
But thatās centralized, different ballpark from p2p. I used to use mullvad for torrents until they removed port forwarding.
I think that question really hinges on āwhat vpn provider you choose to useā. Honestlyā¦ People donāt hit me as hard as I wish they would.
From earlier. ~64TB of that is on my VPNād hosts. I know itās a bottleneck by itās very natureā¦ the highest Iāve seen all 4 peak at the same time was just over 3gbps aggregateā¦
The VPN I use is a no log vpnā¦ and I choose an exit point thatās outside of my country. So at the very least would require coordination between 2 countries, and a provider that has nothing to give upā¦
At that point itās all about the trackers that youāre a part of.
Cool thanks for info.
Jfc please make sure thatās hazard proof and donāt get raided. People like you legitimately make the world go round.
So about thatā¦ I actually got solar installed on my house and when the āelectricianā (subbed out contractor with dubious credentials but was operating under a legit company) ran dedicated breakers for the serversā¦ the junction box caught fire.
That was a fun 2am to wake up at.
But itās pretty safe now. Have had several master electricians come in and evaluate it all at this point and all of them are happy with it now.
What about things like earthquakes, house fire, flood, volcano, tornado, hurricane, crashing plane, theft, nazis, shitty kids, anarchists, or rain?
I live in a geo-stable locationā¦ Lots of DCs here specifically because of that.
Yep. Fire extinguishers are in house, and I check them pretty regularlyā¦ Blaze cut is in the junction box(now) and in the rack. Rack is in garage, so I can just unplug and push it the fuck out (assuming I have time after throwing my kids out the windows).
It was actually my setup that alerted me to the junction fire pre-emptivelyā¦ as power usage was fluctuating wildly and I have Home Assistant alert on that sort of stuff. It only sparked and blew some insulationā¦ The fire didnāt actually move anywhere meaningful and I cut power before it had a chance to get worse. My fire alarm itself is also tied into HASS at this point. So I get alerts on my phone for the rare occasion that I leave my house (most [99%] of my work is work from home, I go to a datacenter probably quarterly at this point for all of an hour).
We barely get rain :(. But because of the soil here thereās lots of washes and irrigation mitigations in place already.
Yellowstone finally going up will just outright kill meā¦ donāt care to mitigate this at that point. Thereās no other active volcanos around.
Doesnāt happen here. Dust devils are about as bad as it gets.
So thereās 2 ways to look at this oneā¦ I live near an AirForce base. Either they fuck up and Iām more at riskā¦ or because the area around the base is no-fly zone, Iām less likelyā¦ I donāt know take your pick. I would hope āless likelyā due to trainingā¦ but Iāve seen stupid shit when I was in the military.
Gunsā¦I have guns. Lots of ammo. A good setup for cameras on my house. And no fucks to give as army training and a deployment has forced onto me. My state is a stand your ground state. If itās my kids that are the shitty kidsā¦ I have a backyard and a shovel (/s).
See āfloodā above.
Other sources of water (water leak): no pipes above the server rackā¦ Water heater isnāt that close, has a freezer in between to take the brunt of any initial impact, and is brand new (so unlikely to spontaneously explode). Rack is elevated on itās coasters and garage is graded towards the street.
We can get some interesting thunder storms here. Rack is grounded, I have backup batteries in the rack and whole house battery from the solar. But luck be what it is, in theory that could nail me as unlikely as it is.
Everything is encrypted at restā¦ Backups are encrypted.
I donāt have a proepr offsite yet. But my cousin is finishing building his house. He also has a fat internet pipe, and Iāll just leave a 25TB node there to backup the important/unreplaceable stuff over there. Heās clear across the country in a pretty geo-stable location as well. And he has an interest in maintaining it as he uses some services that I offer anyway (Email, nextcloud, backups, etcā¦). Everything else is pretty replaceable and wouldnāt take all that much effort to rebuild otherwise.
Never claimed I was āperfectāā¦ But Iām doing pretty well here and have been doing it for nearly a decade this way. With ~30 years worth of data and very little of it lost. (there was one event over a decade ago at this pointā¦ but wasnāt all that bad.)
The real risk is just me doing something stupid since Iām the sole owner and nobody else really knows how to access any of my stuff. My dad has emergency access to my password vault, but even though heās been programming since the 80ās, a lot of my setup is likely over his head.
All this other stuff is pretty low risk/unlikely or has been relatively decently mitigated.
Edit: Ohā¦ and some certain important items are burned to M-discs and put into my safe every quarter or so.
<img alt="" src="https://sh.itjust.works/pictrs/image/9f7e430e-1d42-4607-ba81-196afd6db512.gif">
Ngl I am quite envious. Thatās awesome.
32TB right now.
Got +80TB coming in the mail!
And offside backup coming soon ā¢ļø
Try lvmvdo www.man7.org/linux/man-pages/man7/lvmvdo.7.html
<3
The day the Internet Archive was being attacked and sued, was the signal.
They donāt have to participate, but itās a good article to raise awareness for your non tech oriented friends and family.
This is a massive problem, but at the very least itās happening in an era of very cheap data storage.
I stopped reading at āliterallyā, which was early-on.
did you literally or figuratively stop reading though?
Lots of people hoard data. The problem is keeping it in a working state. Think about how many people have old towers or laptops in their garage or basement never to look at those downloads or vacation photos again.
Iām a huge fan of the golden era of anime fansubs. I know a lot of people still have the files, but theyāre probably squirreled away on an offline hdd or a bunch of dvds, not being shared. Itās quite sad and frustrating. Itās completely lost culture in many instances.
I agree. I recommend most people donāt go overboard, but they can still do their part.
Save the things you like and are relevant to you. Movies, shows, games, music, books, etc. You donāt have to be an archivist. Storing data should be something that reflects you, personally, and it should genuinely be more enjoyable as a result.
It should feel good to preserve and be responsible for another copy of the information you like.
3tb of porn and growing.
momma always said, ādo what you like you thick sumbitch, yer gon do it anyway.ā
she was right. I did it anyway.
Be glad you donāt have VR. Those porn vids get big.
Music is a no brainer for me since itās something that is infinitely re-enjoyable (if thatās a word) and it doesnāt have to take up much space, without reasonable compromises to quality.
I bought a digital audio player last year so that I could be offline and disconnected when I go out but still enjoy music. One of my favourite purchases the last few years.
Donāt think you need to add the suffix. You re-enjoy the old things.
Instructions unclear, setup personal Project Gutenberg mirror.
(Started months ago, actually. Their main archive server isnāt very fast.)
<img alt="" src="https://lemmy.world/pictrs/image/11860d10-4d62-4d2b-bed0-feb792a68e6d.gif">
I just hoarded this gif
Take what you can ā¦ š“āā ļø
And seed the hell out of it! š¦
I donāt know who here likes Horizon games, but I like how many parallels the writers put in the game that reflect the state of the world.
::: spoilerĀ a bit of a game spoiler
Like the whole premise of the story is exactly what this article mentioned: a multi billionaire CEO with a god complex completely wiped out the entire human database to erase any information of how he destroyed the world to protect his ego and image. Also why the new world is basically just bronze age level tribes.
:::
my coolest data hoard (im not insane, I only have like 3tb, mostly of games) was the doom 1993 files.
me at 2am tinkering with my computer had an emotional connection to another computer nerd back in 1995 at like 11:30 at night who was packaging doom files that through dozens of exchanges made itās hands to mine.
Wonder who it was and how theyāre doing nowā¦
i have like 10 tb of documented changes from just the us govnt websites. I log every. single. change. to a selection of both local and federal .gov sites. Ive got a pi, whos only job is to find and log this. I figure this kinda documentation could be historically significant if sombody tries to alter the past.
idk why I do this, I just like the info. I wanna build a website to display these changes.
ik the internet archives existā¦but what if somthing happens?
On an unrelated note: the site has the least invasive adblock banner Iāve ever seen. Made me wish to immediately turn it off.
<img alt="1000073621" src="https://lemmy.today/pictrs/image/defe2def-e619-4518-acb7-8c99a1a04889.jpeg">
Good thing Iām stocking up on used HDDās.
How long do HDDs last though? Iāve got some from 2015 to 2018 manufacture date. Seems dated and old.
The oldest one I have is from 2007. Still works fine. As for how long they last it heavily depends on your luck. Iāve seen HDDās from the mid-nineties that still work, not in person just to clarify. I donāt have any irreplacable data stored on them. Itās also important to use a filesystem that can detect corruption like btrfs, becachefs, or zfs.
Picked up a 24tb external drive. My video collection and stuff is going onto it, so that I can nuke my PCās drives and start fresh. The odds of Microsoft being a Trump Regime collaborator are high, so I want to be ready to hop out of the frypan when the time comes.
Aside from that, I have been ripping and converting my discs again. AV1 offers nice space savings. Patlabor, OG Dragonball, documentaries, all will be updated.