It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
8676
 
 
The original post: /r/datahoarder by /u/AmazingYubi on 2024-06-30 07:39:16.

Hey guys I like saving the stuff I like but recently got into archiving shows so I was wondering are HDDs good for storage like writing to it once then unplugging it and storing ocasionally reading, I'm asking since in the past I've never had a daily use HDD that didn't get atleast some bad sectors but they are cheaper so they seem like a great storage option. HDD or SSD (that has to be plugged in sometimes)?

8677
 
 
The original post: /r/datahoarder by /u/MrJake2137 on 2024-06-30 07:20:40.

Hi,

I've recently bought a new drive (IronWolf 8TB) and copied all my data from old drive at once.

Now I'm in the process of reading this data back and checking md5 and this drive is making hell of a head noise! Shouldn't it just read the data in the linear fashion with not so much head skips? Is this btrfs fault? Or is it perfectly normal?

8678
 
 
The original post: /r/datahoarder by /u/LuckBuff on 2024-06-30 05:37:00.

Hey,

I have this backup archive that contains everything from my PC, laptop, phone, etc. It even has files over 10 years old. I'll transfer them to an external hard drive, but I want to make sure that there are no viruses in it because let's say, I wasn't really virus careful 10 years ago.

I'm looking for something free since it's going to be a one time thorough scan.

Any recommendations? Thanks!

8679
 
 
The original post: /r/datahoarder by /u/Icy_Pineapple_3846 on 2024-06-30 04:30:56.

I just got a new iPhone, and I immediately noticed a big flaw compared to the Android phone that I have. I consistently use Capcut to edit videos, using MP4 videos saved on the phone as sources. Howver, Apple seems completely opposed to any sort of file management, so it seems impossible to build up a library of clips to edit with (let alone manage files on the phone in the first place). Does anyone have any idea how this sort of file management works on iPhone?

8680
 
 
The original post: /r/datahoarder by /u/david87 on 2024-06-30 02:00:30.

I'm wondering if anyone could recommend a similar photo detection tool that is likely to match a scan of a print with a scan of the photo's negative.

I have piles of old family photos in shoeboxes that were separated from their negatives, which were kept in the original photo lab envelopes. I've had all the negatives I could find scanned and would love a semi-automated way to find the few photos in the piles of prints for which I was missing negatives. Passing the prints through a fast scanner with a feeder would be much less onerous than manually matching them up.

Last time I looked for such a thing was approx 10 years ago and I remember not being very impressed, so any suggestions would be very much appreciated.

8681
 
 
The original post: /r/datahoarder by /u/Towbee on 2024-06-29 23:35:41.

Hi! To preface, sorry for the extremely long post, if you'd like to just give some information about one small thing feel free as I will appreciate anything.

I used to be into PC gaming but due to some unfortunate life circumstances I have managed to kick the habit entirely. Now I have a very fancy paperweight of regret staring at me daily.

I have a plex server running on windows off of my previous gaming PC, though it's full with a measly 4TB and the case cannot fit any drives, I've been waiting to re-build it in a new case, using unraid and some actual big drives, then it struck me I could possibly re-use some parts from both machines to build what I want and sell the rest since I have no desire to game anymore.

I'm a bit stuck on whether this is a good idea or not though. I don't know if it would be financially better to sell all of it and begin again? Bearing in mind I'll be selling the things cheap for an easy sale - I'm really not great at handling interactions like this so I let them go relatively cheap and hassle free usually.

Anyway enough rambling, the parts I have to re-use or sell are:

previous pc:

  • CPU: i9-9900k
  • CPU Cooler: Some form of AIO
  • Motherboard: Z390 Aorus master
  • Ram: Corsair 32GB DDR4-3200 (4x 8GB sticks, RGB lighting so I guess I could sell them for more?)
  • GPU: 2080ti (Can this be used for any potential VM applications if I want to run beefier programs remotely or something from a laptop?)
  • PSU: Can't remember and can't get to the pc, think it was some non modular bronze corsair one

current PC:

  • CPU: i9-13900k
  • CPU cooler: Lian li AIO
  • Motherboard: ROG Maximus Z790 hero
  • Ram: Corsair 32GB DDR5-5600 (2x 16GB sticks, RGB lighting again)
  • GPU: Already sold
  • PSU: Some modular thermaltake atx 3.0 gold PSU

From both:

  • Storage: A variety of 1TB/2TB M.2 SSD's, can I use these in the Raid setup? Can I put the actual OS on them or is there no benefit for a NAS? I think there's even some 2.5" Ones also
  • More storage: A variety of older, random sized HDD's 1TB, 2TB, 4TB etc. Can I use these with my new ones I'll be getting or am I better off not doing that?

So the form factor will possibly play into what I do, if I want it to be a small machine then I have no choice but to sell the motherboard to get a smaller one to fit one of the CPU's, but if I do that am I better off downgrading the CPU and just sell both MOBO+CPU as combos together? I'm also a bit concerned about a smaller MOBO in general since the selection seems to be very limited

Case wise I've been eyeing up these

  • Node 304/804: These seem to be one of the "old reliables", but as most I was disappointed by the outdated I/O and on the 304 worry about temperatures. I'd rather lose some space (or.. gain?) and know the temps will be alright
  • Jonsbo N2: I really love the tiny form factor, and it has a reasonable amount of drives that will stop me going crazy on getting too many. I guess a huge downside is being restricted to ITX though?
  • Jonsbo N3: Seems like more drive capacity vs the N2 but the same ITX issue?
  • Jonsbo N4: Again bigger than the N3 and has the benefit of being able to take m-atx?

For any smaller form factor though - I will have to replace the board anyway so perhaps it's best to go for the smallest form factor in the N2? Also if anyone knows of any other good cases feel free to throw them out I feel like I've looked at them all but I'm sure there's always another out there

And what I will do with the machine, will be mainly plex/data storage. But as I get into other hobbies and expand my interests I may want to use it for something more - in which case if I can have a machine capable of doing that with the parts I have then may I may as well just use them even if it's overkill? especially if I won't get a good price for my used parts..

I also don't know if I should 2x 20TB drives, or 4x 10TB drives. My current setup is just running one drive and I don't really know much about raid, I know I want to be able to back everything up with an equal copy so I imagine I will only get 20tb of actual storage no matter what option I pick, but is it better to spread out the amount of drives to have less risk of failure?

The entire thing is overwhelming me, and I honestly feel like chucking it all away and crying sometimes. I need to do something with it as I know it's all losing value and I'm annoyed at myself for wasting the money on it in the first place. I've had a lot of problems recently and dissecting this entire topic feels like a minefield so as I said in the beginning I would appreciate any help with this, I feel like a complete failure right now and I'm determined to get this job ticked off my list of shit to sort.

Thank you in advance for any time you give helping me out

8682
 
 
The original post: /r/datahoarder by /u/mammabear9 on 2024-06-29 22:37:36.

I'm going to be traveling soon and I will be away for at least a month with no access to wifi or internet. I'm looking for a good external hard drive that will plug into my phone so I can download audiobooks and movies and then access them easily while away. I would also like at least a 2 TB capacity. Any suggestions are appreciated.

8683
 
 
The original post: /r/datahoarder by /u/oo_sophiana_oo on 2024-06-29 21:42:05.
8684
 
 
The original post: /r/datahoarder by /u/eyeseeyou7 on 2024-06-29 21:39:27.

Or any other ways to bulk download patreon audios?

8685
 
 
The original post: /r/datahoarder by /u/noideawhatimdoing444 on 2024-06-29 21:16:23.
8686
 
 
The original post: /r/datahoarder by /u/owlandtanager on 2024-06-29 20:03:38.

Hello- i'm a bit of a data-hoarding archivist beginner, so forgive me if this is common knowledge among the community. I have attempted to search for answers to my question with no luck. My predicament is-

I am attempting to search for a specific video on archive.org. I have found many great videos "manually" on the site, as in not by search engine but finding a broad upload that is visible in metadata search. (E.X. titled "1990 Broadcasts") and command+F searched the page to find that the video I was searching for was in the numbered chapters of the main upload, but did not turn up in archive.org metadata search results. When searching for the particular video segment in the creator's metadata seach, nothing returns, though I know it is there as I just found it. Being able to search for these chapters would save me hours of command+F on random mass video uploads and just being able to find things archived in general.

I understand if my terminology is off and you need me to clarify to help me- if so please ask me to elaborate. Thank you for your time and help.

8687
 
 
The original post: /r/datahoarder by /u/Garry-Love on 2024-06-29 19:16:15.

I'm wiping windows OS from my childhood computer. My mum died in 2017 when I was 15 so I don't have much to remember her by and I'm not sure if I have pics or videos with her in them on this computer and I wouldn't want to lose them if they're there. There's also childhood pictures of me, my friends and family that I want to preserve. There's like 4000+ pictures of jpegs and pngs and a few .mp4s. I don't know if there's any important stuff in other file formats. They're not organized on this PC at all, I only know they're there thanks to the power of everything from voidtools. I'm a software engineer so I know my way around APIs and libraries etc in a lot of languages. If anyone knows an application/tool, API or library like everything from voidtools that allows me to query all .mp4/.jpeg/.png files on my computer, regardless of where in the computer they are, including in the "users" folder and back them all up onto an external hard drive that would be amazing.

All help/suggestions are appreciated.

Since I know people will probably ask, I'm wiping windows from this machine because it has 4GB of ram. It's practically unusable. I'm putting a lightweight Linux distro on it and utilizing the disk drive for ripping ROMs from my DVDs to add to the family NAS I'm working on.

8688
 
 
The original post: /r/datahoarder by /u/102938qwer on 2024-06-29 18:44:52.

If you want to rescue your content before it is deleted this August, I wrote a script to download and export all channels to an offline, browsable archive. Supports reactions, threads and custom emojis. It’s free.

Slack EscapePod

https://github.com/torgtrungus/slackescapepod

8689
 
 
The original post: /r/datahoarder by /u/Belacboi on 2024-06-29 18:33:38.

So right now I am using a dell optiplex 9020 with some old 1tb hdds running truenas that I threw together for basically nothing, and it is time for an upgrade.

I installed a 2.5 gb nic in the optiplex and have a 15ft cat 6 cable running between it and my computer (also with a 2.5gb nic). I set up static IPs on the nas and my computer and it gets ~130 mbps when transferring movies.

I have been looking into building an ssd nas for low power consumption, low heat, low noise, (maybe in the: ASRock DESKMINI X300W Barebone, if you have any other suggestions for small computers with at least 3 ssd slots let me know) and am wondering what the optimal configuration would be for high transfer speeds directly to my computer. If I use the computer listed above, what would be the best config for its 2 sata and 2 m.2 slots?

The reason I'm not using a switch is because it was too expensive at the time when I built the nas, but if that is better then using a direct link- let me know.

I don't really care about the speed to my network as my house is setup with cat 5e cables, and my wifi is 25 mbps at best.

Also, is it even worth it to use nvme for my storage with a 2.5 gig link? Will a sata drive make use of 2.5 gig? Is it worth it to upgrade to a 10gig connection? Is it worth it to just buy a switch?

8690
 
 
The original post: /r/datahoarder by /u/Pommes254 on 2024-06-29 18:03:36.

My old storage controller / server (2x E5 2680v4 in a Supermicro SC216 with tons of HBAs) has served me well over the years but is finally starting to show its age. So i am starting to build a replacement.

First step - The case

I am keeping all disks for permanent mass storage inside several jbods so no 3.5" bays needed on the server, the only disks that will be inside the server are 2.5" SSDs or U2s for the OS, VMs & Caching

Must have

  • Rackmount 4-6u
  • lot of 2.5" bays in the front
  • lot of pcie slots
  • ATX Mainboard Support
  • U2 support or at least removable backplane

Additional Wishes

  • 48 bay 2.5" in the front
  • low noise (somewhat)
  • More PCIE slots than the mainboard to allow for SFF8644 to SFF8643 adapters

Some other notes regarding the setup

  • Storage / Disks is Managed by Proxmox & all the fileshares are handled by LXCs running SMB & NFS
  • Currently 7 JBODs conencted but might grow in the future
  • Filesystem will be ZFSs so lots of ssds for special metadata deivces
  • Likely a Gigabyte or Asrock E-ATX Mainboard with a single AMD Epyc from the Rome generation
  • Several HBAs (LSI 9305 & LSI 9400)
  • Probably 8 U.2 drives for very fast storage

My current favorites is this one

https://www.alibaba.com/product-detail/4U-48-hot-swap-bays-2_62160857012.html

It checks all the boxes, 11 pcie slots, 48 bays, removable backplane with one for 8 disks

Also looking at the fan design and their other cases it is also quite easy to see that they are one of the manufacturers for Intertech (budged European case manufacturer similar to Rosewill in the US)

Another thing is that those fans can be easily swapped to quite 120mm Noctua or Arctic P12 Max while keeping hotswap functionality and it fits standard 2u redudant PSUs.

What do you think?

Is there anything similar from supermicro?

8691
 
 
The original post: /r/datahoarder by /u/NathanGoatTv on 2024-06-29 17:30:02.

I'm attempting to do what the title says. I have a sata to usb adapter, but the HDD doesn't spin upon plugging it into my laptop, and as a result, the laptop doesn't recongnize it. Do I need another cord? Any help would be greatly appreciated.

8692
 
 
The original post: /r/datahoarder by /u/ApartmentImmediate33 on 2024-06-29 16:51:18.

hi guys is this HDSentinel 100% accurate i mean after 148 days my HDD or windows will not load or what is this just a prediction and number ? i am really wonder

i have other HDD but want to use this as much i can

https://preview.redd.it/yfl1ap71jj9d1.png?width=1920&format=png&auto=webp&s=75f2f0077707f7779fe85da520a3c8c839d7f941

8693
 
 
The original post: /r/datahoarder by /u/DGU_kibb on 2024-06-29 16:48:29.

I'm planning a nas rebuild, and I'm 100% going for that jonsbo n5 when it comes out. I believe it has a 12 drive capacity and I'm planning to start with 8 12TB drives.

My current board is a MSI PRO B660M-A WIFI DDR4 LGA 1700. I was thinking I'd just find another lga 1700 board, but nothing seems to be available with more than 8 SATA ports.

How exactly are all of you running so many drives? If there's more than one way, whats the most braindead simple way to do it?

Also, what do you guys do for RAID in your systems? I'm currently running a Raid5 but I found out after the fact that apparently some people explicitly recommend against this? After all the tinkering I did on my last build I just want my next one to be as idiot proof as possible, so it'll just be running normal windows. I'd like to maybe do double parity and ability to add more drives after the fact, so maybe raid 6, but idk, curious to see what others do.

8694
 
 
The original post: /r/datahoarder by /u/mrmees on 2024-06-29 15:41:15.
8695
 
 
The original post: /r/datahoarder by /u/mactep66 on 2024-06-29 15:19:58.
8696
 
 
The original post: /r/datahoarder by /u/cofango on 2024-06-29 14:39:35.
8697
 
 
The original post: /r/datahoarder by /u/Trigonometry_Is-Sexy on 2024-06-29 13:21:14.

Have been using a toshiba HDD on different consoles for years and on my Xbox for a year and a half and was thinking about how long it would take to redownload all my games if it died.

So I'm going to get an SSD, I have a SATA enclosure that I'm not using but if needs be I can get a NVME enclosure(with thousands of good reviews) for cheap enough.

So my Sata options are(Some don't have DRAM).

  • €98: Crucial MX500 1 TB
  • €97: Samsung 870 QVO SSD 1TB
  • €81(was €126): SanDisk 1TB PLUS
  • €76(was €88): Crucial BX500 1TB
  • €77: WD Green 1TB

NVME options

  • €69(was €109)- Crucial P3 1TB
  • €77(was €160)- WD Green SN350 1TB
  • €76- WD Blue SN580 1TB
  • €85(was €111)- WD Blue SA510 1TB
  • €79- WD black SN77

So what one would you pick in my shoes?

8698
 
 
The original post: /r/datahoarder by /u/LePoissonBanane on 2024-06-29 13:14:19.

Tech novice, looking to consolidate files (media, documents) from multiple sources (various old computer and external hard drives) on a single high capacity external HD (will back up with a second one). Essentially looking to take advantage of modern drive capacity for a physical office cleanup and consolidation. Maybe 10-20 Tb in total. Im wondering if there are any good software utilities that will reliably spot duplicate files and deal with that? Also, when copying data over from old HDs, how do you make sure it isn't corrupted and that it copies well? Any advice on this big one off project would be highly appreciated.

8699
 
 
The original post: /r/datahoarder by /u/some1stoleit on 2024-06-29 10:26:14.

Recently I've realised I've more or leas been just sitting on my NAS data, not even using it all that much myself.

I thought I could add to the archiving efforts of the internet via peer to peer torrent sharing.

I do source some things for torrentd, but more often than not I end up needing to rename or restructure things, and I can't seed properly anymore.

So I figures I can create my own torrents and spread the things I downloaded.

I wanted to clear up a few things.

1 - If I share copyrighted content can I get in big trouble, large fines etc. I know movie companies don't care about downloaders and leechers but they might cade about people seeding and uplaoding.

2 - How should I go about doing this? I imagine its best to use VPN, I'd have to create torrent, and upload somewhere. I get the workflow but if someone cab point to specifics that would be great.

8700
 
 
The original post: /r/datahoarder by /u/NWSpitfire on 2024-06-29 10:23:14.

Hi all,

I have been using LTO-4 for a few years in my home lab and it has worked great (and saved my butt a few times with hardware failures etc).

However I have to manage a server that holds around 24TB currently (and growing by roughly a TB+ per month) of aviation videos. This server automatically backs up to Backblaze but I’m uneasy about it being enough.

I do at this point use my LTO-4 drive to back up very critical videos but in order to back up the entire server I’d need some 30 tapes with another 2 needed every month (and while the drive still states 99% health on everything, it is quite old).

LTO-5 on the other hand I would only need 16 and one new tape a month. I considered LTO 6 but it is quite a price jump and I’m not sure if it is worth it?

I have seen an LTO-5 tape drive (although it’s out of a Quantum enclosure) for £50.00 with a 90 day warranty. For tapes themselves I can either buy new for £18.00 each or a box of 20 used for £59.00 (although I’m told used tapes are a bad idea).

My 2 questions are can autoloader Fiber attached tape drives be used with a SAS interface outside their enclosure (in a PC). And, is this a good deal or a terrible idea as a second backup for my data? The alternative is I’m going to have to spend £1000+ on several new hard drives to back this all up. But it gets difficult because to add more storage I have to add several more hard drives vs the convenience of just buying another tape.

What’s your opinions?

Thank you

view more: ‹ prev next ›