The original post: /r/datahoarder by /u/furllamm on 2024-10-11 10:20:58.

title

edit:

when i cut and paste when i cut and paste into a folder....

i hate windows computers #hatewindows

The original post: /r/datahoarder by /u/Plexidyt on 2024-10-11 09:24:32.

The title explains everything. I have a bunch of DVD-Rs that i bought a few years ago, and maybe data hoarding would be a valid option? I am not really into it, but want to get in.

The original post: /r/datahoarder by /u/Sarke1 on 2024-10-11 16:40:04.

The original post: /r/datahoarder by /u/Far_Marsupial6303 on 2024-10-11 16:26:54.

Brewster Kahleu/brewster_kahle

Update:@internetarchive’s data has not been corrupted. Services are currently stopped to upgrade internal systems. We are working to restore services as quickly and safely as possible. Sorry for this disruption.

11:08 AM · Oct 10, 2024·

https://x.com/brewster_kahle/status/1844485102312751421

The original post: /r/datahoarder by /u/LaundryMan2008 on 2024-10-11 15:37:04.

I have changed the format of my posts slightly from now on because the old format had a neatly swipable picture album but the text had to go into the comments because Reddit does not let me have text and neat pictures but it's harder for people to find the comment so I decided to put the text in the post but the images won't be neat anymore which is a small price to pay but well worth it, apologies for people that have trouble seeing my post from now on but I also had trouble seeing the last photo of all of my posts so I hope this new format fixes it for you.

The first picture is just a general image of all of my data storage formats up to now

The second picture is my reorganizing of the standard optical media, I already had a few because my dad used to burn copies of movies and games so I went through them and took the ones I didn't have yet, I also added a DVD - and + RW because I used them extensively for moving files to my data storage media testing computer which is an older one without USB, don't worry if you don't see a specific optical disc on there because I have a lot more silhouettes and discs to hang up, these ones do not have a 3.5" counterpart and will be put up on the side to the optical discs with a minidisc counterpart, please do tell me if there are any other standard sized optical discs that does have a minidisc counterpart.

The latest addition is DVD-RAM, it's an optical disc that behaves like a hard drive that enables drag and drop, you can add and delete stuff like it is a hard drive but it's a slow one, it was mainly used to store lots of data and move it to printing presses, it was also a reliable media because it could last up to 30 years in a good environment, it's also the only consumer optical only disc to have hard sectors, the other hard sectored discs were for professional data center use and usually were big disc cartridges, the hard sectors allowed for the disc to be multi session and its low 2KB block size reduced wasted space allowing you to pack lots of data on one disc, the 5.2GB on the shutter is a misnomer because it's actually 2.6GB on one side and both sides add up to 5.6GB like a 5.25" floppy disk.

I am not making as many posts as I used to because my media which is tested and guaranteed (unless it’s very obscure {example ZX Microdrive} or the drive is too expensive {example LTO}) just isn‘t selling quick enough to be able to make more often posts, if they did, I would be making posts much more often.

Link to previous post, post 5 (9th week): https://www.reddit.com/r/DataHoarder/comments/1eu0gn8/my_data_storage_mediums_post_5_9th_week/

General picture

Standard sized optical discs and their minidisc counterparts, I have 2 minidiscs (3 if you count the audio magnetoptical minidisc) and I find them really cool

DVD-RAM cartridge

The hard sectors within

The original post: /r/datahoarder by /u/Theslimyboi on 2024-10-11 13:39:15.

I am planing on expanding my storage and revamping old setup but sadly from what they are giving me is minimum 40$ just for shipping and I am interested in europian alternatives to this side

The original post: /r/datahoarder by /u/RulerTitan on 2024-10-11 12:37:46.

The original post: /r/datahoarder by /u/muddbone46 on 2024-10-11 10:40:44.

Looking to store some files and I’m not sure about what media to use. I’ll be placing it in a fire resistant pouch which will be going in a fireproof safe/box so the amount of space is limited. What I’m concerned with is possible failure of the box or pouch as they’re both rated for exposure time. My first thought is an aluminum cased thumb drive over the card or SSD. Any advice?

The original post: /r/datahoarder by /u/Void_0000 on 2024-10-11 09:27:20.

I have an old laptop that I've repurposed as a somewhat decent home server, the problem is that it really does not have much storage at all, so I'm trying to come up with a cheap way to fix this problem.

A bunch of local resale sites where I live are pretty much always full of fairly cheap drives (~5-10$/tb), with the notable downside that they're usually not very big drives (500gb to 1tb usually, sometimes 2tb). My plan is to buy a bunch of these and add them all together to get something approaching good capacity (this isn't really intended to store any data I can't afford to lose, and I plan on making backups of anything important anyway so the drives being second hand isn't too concerning to me).

The problem is that most ways of connecting a sata hard drive to a device with USB seem to be so expensive that the overall price per-tb starts to approach the cost of just buying a brand new external HDD. My main issue comes from the fact that to make this work I would need to connect lots of small drives rather than a few large ones, and since the cost of the actual "connection" part is per-drive, the per-tb price starts to suffer pretty quick.

Solutions I've considered:

1. USB DAS enclosures: even the cheapest ones I can find are ~20$/drive, assuming <=1tb drives, even at 5$/tb for the actual drive it's still easily less expensive to buy brand new external HDDs (~20$/tb). Is there anything cheaper? I don't need any extra features other than holding hard drives and letting me access them via USB.
2. Throwing a bunch of hard drives in a box and connecting them all with SATA to USB(+12v barrel jack for 3.5") adapters and a USB hub: SATA to USB adapters that support an external power connection for 3.5" drives are also about 20$ each, with the exception of some suspiciously cheap ones on aliexpress that only cost around 5$. Also, this sounds like a total mess. Is there maybe such a thing as a many-to-one SATA-to-USB adapter?
3. Docks: For some reason, USB hard drive docks seem to be significantly cheaper than both of the above solutions, even though they should be using the same hardware, though I have no idea why. This would be a bit of a pain because I'm also limited in terms of physical space and docks tend to use up a lot more of it than enclosures. Maybe I could buy a cheap one and scavenge the electronics from it to make something smaller (basically solution #2)?

Lastly, I've read you can connect a near unlimited number of drives if you have a spare pcie card slot for a controller, though I don't really know anything about how this works. Naturally, my laptop is... a laptop, and so doesn't really have spare anything, let alone an actual pcie slot, but it does have both an ethernet port and a wifi card that I know is easily removable. I've seen people use the slot freed up by removing the wifi card to attach entire graphics cards to their laptops, so I wonder if this could work for attaching hard drives too? This would really be my last resort, though, because I'd rather not have to put a hole in the laptop's case and having separate physical interfaces for WAN and LAN is pretty convenient.

The original post: /r/datahoarder by /u/manzurfahim on 2024-10-11 08:02:27.

https://preview.redd.it/dvd3as3s13ud1.jpg?width=505&format=pjpg&auto=webp&s=2fa50bf2cf915240737c077275a091f342f1b7e1

A good percentage of upload goes to RARBG and the ones that were difficult to find (public trackers and btdig etc.) but it feels good to see that many others are looking for the same files and now they don't have to wait as long as I did for them to complete.

The original post: /r/datahoarder by /u/Tiritibambix on 2024-10-11 07:57:37.

Hi everyone!

I've been using Create-Synchronicity for a few years, and it's been great for my needs. However, it hasn't been updated in a while, and I'm curious if there might be a more current alternative out there.

I'm looking for features like mirror, incremental, and two-way incremental backups, as well as the ability to schedule my backups.

There are plenty of options available, so I thought it would be a good idea to ask you all what you're using and what you would recommend.

Thanks a bunch for your help!

The original post: /r/datahoarder by /u/Evee101 on 2024-10-11 07:52:48.

Hey all,

I'm stuck with a website that, amongst other things, has the ability to alter files that have been uploaded. The objective is to clone the entire website and its ability, and then host on a local home server for own use.

A site that works as a perfect example would be: https://www.visualpdf.com/

i.e. upload files -> edit files -> save edited files

Any advice to get this done in a simple way?

tyia :)

The original post: /r/datahoarder by /u/KimuraBotak on 2024-10-11 07:00:09.

Just bought a renewed 16TB hdd from amazon for my home DAS. Have initialized the disk with windows 11, now I about to start the formatting.. should I just perform a quick format, or rather do a full format instead?

Which one should I do in order to get a more healthy/longer lifespan out of it? (especially its already renewed) Or does it worth doing it, as it takes longer time? And what should I do next after the formatting?

The original post: /r/datahoarder by /u/Far_Marsupial6303 on 2024-10-11 05:13:11.

Prayers and cares to everyone in Florida and any other weather affected areas.

I have no affiliation to ServerPartDeals, Water Panther, Tech On Tech or Complity?, and previously questions their connection and criticized Water Panther which was banned here and other subreddits, including their own for spamming.

However I appreciate someone from there sometimes posting here and explaining the affiliation between the companies here: https://www.reddit.com/r/DataHoarder/comments/1al4dlr/water_panther

That said, ServerPartDeals posted an optimistic message on their website which I just saw and despite their optimism and the heavy damage in Florida, it's likely they won't be open or online for a while.

ServerPartDeals is officially closed due to Hurricane Milton. We will be closed Wednesday and Thursday (10/9-10/10). We plan to reopen Friday depending on the extent of damage from the storm. We will update you on our status as soon as we know more. Thank you for your patience and understanding.

https://serverpartdeals.com/

The original post: /r/datahoarder by /u/Muslim_Wookie on 2024-10-11 05:04:10.

Currently I am running OmniOS v11 r151044k and napp-it, in a 24 bay case, fully populated.

At the moment I am running it as a VM on ESXi with SAS cards passed through - I don't really have any desire to change this configuration. Now is not the time in my life to start exploring proxmox or other bare metal options.

However, I am getting a bit tired of the napp-it interface - the guy that puts it together is a real gentleman and does his best but between the language barrier and his skill set I don't think napp-it has much of a future.

I don't have a problem with CLI (and in this context, CLI and zfs) BUT I want to keep things simpler at home and not be "working" at home. A nice Web UI would be fantastic to have.

Some features I like from napp-it are the physical mapping of drives onto a virtual picture of my NAS and the monitoring features.

I am looking for something where I can keep the same functionality as I have now but be in a more mainstream release where things like installing a zabbix2 agent requires no thought from me.

Does anyone have any suggestions of what I should look at to replace OmniOS and napp-it?

The original post: /r/datahoarder by /u/Quadwaves on 2024-10-11 04:53:42.

im told M discs can keep data for 1000 years without power and I'm also told internal hdd>ext hdd but like ext hdd should be able to keep my files for life right? it's protected in a casing and if anything a internal hdd when taken out will have no protection right?

The original post: /r/datahoarder by /u/riade3788 on 2024-10-10 23:52:43.

I've seen this term used all around by sellers and it seems throughout this community but aside from a failing circuit board I don't see any chance for refurbishment so what are those exactly aside from a really used but still functional or open box second-hand HDDs?

Maybe I'm smoking meth here but it seems to me all they do is format the drives and call them refurbished?

The original post: /r/datahoarder by /u/xxjosephchristxx on 2024-10-11 03:46:58.

I need to store and remotely share large video files. Raw documentary footage. I don't care much about watching or working with the files on/from the server. Upload/download speed & stability would likely be my top priority.

Would unraid or trunas have an advantage?

Any help would be greatly appreciated.

The original post: /r/datahoarder by /u/GreggAlan on 2024-10-11 01:53:41.

I want to copy the files from a USB 3.0 8TB mirrored drive pair (hardware mirror, not Storage Spaces or other software) to a single 12TB USB 3.0 drive, reformat the mirrored pair, then copy everything back, in order of largest file to smallest.

Why? Because the files are an extremely fragmented mess and defraggers tell me it'll take a very long time to sort the mess. I know it'll take 2~3 maybe 4 days to do the copy then copy back.

The fastest defragger I've tried so far is the old MyDefrag. I could let that chew on the mirror pair for as long as it takes - except it has that pointless translucent window that tells what the different colours mean. That window cannot be closed or minimized. I figured I'll just use Task View, launch a second desktop then run MyDefrag there. NOPE! That un-closable window shows on *both desktops*. That's some Microsoft Clippy level of horrible, annoying software design. Since MyDefrag's author quit on it back in 2009, that "feature" isn't going to be fixed.

I'm tempted to temp setup a second monitor to see if that "helpful" window duplicates onto both physical screens.

The original post: /r/datahoarder by /u/InternationalMany6 on 2024-10-11 01:45:12.

I have some very large collections of files organized into nested folder structures, which are currently spread across a few 8 TB USB drives. All in all it's more than 100 milion files, and I have a particular read pattern I usually follow where it would make sense to split them up across different drives based on the last part in the filename.

For example *A.data should be stored on drive 1, *B.dats on drive 2, and C.data on drive 3. The * is an incremented number that would be the same for all three files, and it basically represents a timestamp. The program I use to access these files always reads them in groups of three, so this organization scheme optimizes throughout 3x.

This is actually a program I wrote and that's actually how I currently lay out the files on different drive letters, but it's become a pain to manage the code so I'm wanting to offload the functionality and just have my program think it's reading everything from a single drive letter.

Can DrivePool handle that configuration based on the last part of a filename? Does its performance suffer much compared to using native NTFS once 100+ million files are involved?

Edit: in case it's not obvious, my program is multithreaded so it issues multiple file read requests to the OS in parallel.

The original post: /r/datahoarder by /u/OkStrategy685 on 2024-10-11 01:23:58.

Hey all. I just ordered a 512gb USB 3.2 gen 2 https://www.newegg.ca/kingston-model-dtmax-512gb/p/0BD-00CA-00FJ1?Item=9SIA7BBHFC8434

I was first wondering about the USB and If it would be best to have Hasleo backup directly to the stick everytime? or maybe one of the network drive and the stick?

and an 8tb hhd https://www.newegg.ca/seagate-ironwolf-st8000vn004-8tb/p/N82E16822184796R?Item=N82E16822184796R

Then I just noticed that this hard drive is for an NAS? if so will I still be able to use it in my storage network? It's just a few Shared Network Drives on my old pc. it's actually been very useful for me.

But any advice would be great. I think I messed up on that hdd tho.

Thanks all.

The original post: /r/datahoarder by /u/Zelderian on 2024-10-10 23:57:19.

I’ve started on my movie/show collection and have probably 600GB of data so far. However, I never noticed the true value until the hurricane knocked out our internet, and it’ll be out for a total of about 3 weeks. Having a bunch of content available to watch even when the internet is out is pretty awesome, and I’m excited to keep gathering my collection over time. Ready to upgrade!

The original post: /r/datahoarder by /u/Valuable-Speaker-312 on 2024-10-10 22:13:07.

https://preview.redd.it/di0r85gf60ud1.jpg?width=1536&format=pjpg&auto=webp&s=714ce8ddbc30369d0f3b92e5d9487362c9809531

The original post: /r/datahoarder by /u/Agreeable_Repeat_568 on 2024-10-10 21:51:37.

I know I can get a LSI hba but I don't see the need for the extra power consumption with the chip on the card and not supporting ASPM. I need to add another sata controller as I am moving proxmox boot disks from mirrored nvme to mirrored enterprise sata ssds. My motherboard has 8 sata ports but I am passing through the controller to unraid so I need to add another sata controller for proxmox boot. I was originally thinking about a simpleASM1166 on a pcie card(didn't really give enough ports) but then I stumbled across the ASM2812 and ASM2824 with on pcie. So my question is can I use a combination of both and use 2x M.2 ASM1166 adaptors with the ASM2812 PCIe 3.0 X4 Adapter with PCIe Bifurcation Function. My motherboard doesn't have bifurcation. I know the ASM1166 are low power at about 2 watts each so 4 watts, what I am not sure about is the power consumption of the ASM2812 and will they will even work in this configuration. I know the lowest an LSI board will give is about 6.5watts and that's only for 8 ports, this setup will give 12 ports possibly with the ability to separate the controllers to different VMs? Any one know if this will actually work and is stable?

FYI I am planning on using the motherboard sata controller for proxmox boot and use the dual M.2 ASM1166 for unraid. With my motherboard if I add a pcie card in the 3rd pcie slot the 8 sata ports are reduced to 4 ports because they share bandwidth.

I did find this post doing the same thing but I still have my questions if this is even a good idea.

The original post: /r/datahoarder by /u/Darkmatterx76 on 2024-10-10 21:36:39.

Is WD still the top name in HDD product quality/longevity? I'm thinking Red Pros for NAS. 2 16TB Red Pro's for 16TB + backup.

Thanks!