It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
6876
 
 
The original post: /r/datahoarder by /u/gatorboi326 on 2024-09-02 16:12:10.

I want to recover of deleted data from storage devices is essential for reconstructing timelines for critical information. Traditional file systems like FAT and NTFS have been extensively studied, and tools for recovering deleted data from them are relatively mature. However, modern file systems like XFS and Btrfs, designed for performance and reliability, employ complex data structures that pose signifycant challenges for data recovery.

Is there any utility to recover deleted files along with their complete metadata, such as creation, access, modification, and deletion timestamps, is crucial for establishing timelines.

ik extracting metadata from XFS and Btrfs file systems requires a deep understanding of their internal structures and data allocation mechanisms. Anyhow can someone help in this regard

6877
 
 
The original post: /r/datahoarder by /u/Ok_Wolverine_4268 on 2024-09-02 15:29:07.
6878
 
 
The original post: /r/datahoarder by /u/amrogers3 on 2024-09-02 14:41:02.

Hello

The Synology site says the following 12TB Ultrastars are compatible with my DS214+

HUH721212ALE600
HUH721212ALE604
HUH721010ALE600
HUH721010ALE600

However, the one I am looking to buy is a 12TB HUH721212ALE601

Are these drives that different that I wouldn't be able to use the HUH721212ALE601 it in my 214+?

Thank you

6879
 
 
The original post: /r/datahoarder by /u/kevstiller on 2024-09-02 13:36:52.

Has anyone encountered any good deals for internal 3.5” drives this Labor Day? Looking to get my first NAS and wanting to load up w either ~10TB drives

6880
 
 
The original post: /r/datahoarder by /u/CryGeneral9999 on 2024-09-02 13:28:02.

I'm looking to get a new-to-me machine to use as a Proxmox server. I'd like some horsepower, and I see there's quite a few selections of dual Xeon workstations out there. I don't have a rack so the rackmount stuff is out (plus, my experience is the workstations aren't as loud). I'm looking at the newer Silver/Gold/Platinum CPU's, something with DDR4 minimum. I currently have a HP Z6 G4 and like it but I need it for work so can't mess with it. I've looked at the Lenovo P920, HP Z6/Z8 G4, Dell T7920. My Z6 is nice but the storage is all internal, I'd really like something with a backplane and exterior drives, or the ability to upgrade to that (I see the P920 has backplane kits?). It also uses a daughter card for the 2nd CPU whereas the G8 uses one board with both CPU's. I plan to use 3.5" spinning drives for storage but would like to use NVMe for OS and VM's so I'd like at least a couple NVMe slots.

Are any of these brands workstations a better platform for building out a storage VM server from it?

6881
 
 
The original post: /r/datahoarder by /u/thequestison on 2024-09-02 13:05:00.

I have several nas where I have copied various drives over from failed computers etc, that have many duplicates years. I have moved them recently to be larger nas, and now wish to clean up the files. Any advice on programs to do this massive undertaken is appreciated. Programs and methods or ideas how

6882
 
 
The original post: /r/datahoarder by /u/loverofLove96 on 2024-09-02 11:34:40.

I have a collection of web courses that I want to store on my NAS and be able to access them via a UI. Any app suggestions that you guys have used and worked?

6883
 
 
The original post: /r/datahoarder by /u/weblscraper on 2024-09-02 11:34:38.

I am planning to buy an adapter PCIE 16x to m.2 4 slots but I have seen some videos online saying that those adapters are very slow

https://amzn.eu/d/54Sk8i8 This is what I’m considering

Would I face any problems with it? Or bottleneck?

If there are other alternatives (better or not) to add more m.2 drives you can let me know

My OS is truenas scale

6884
 
 
The original post: /r/datahoarder by /u/New-Seaworthiness-58 on 2024-09-02 10:57:55.

This has happened to 3 separate external storage devices. I used to think my old External Hard Drive was just faulty, so I bought a new online. Same thing happened to that too, I thought maybe I got scammed and bought a broken device. YES. I've been told to check the integrity or health of these storage devices and turned out ok. But the problem persisted.

So I went to the HP store and bought a brand new 500GB Flash Drive just today. As I've done before, Formatted it to NTFS -> Default on the Memory Allocation so I can transfer files above 4gb.

Transferred my files. Everything seemed fine at first. BUT at some point in transferring, files started to become unreadable. Examples: Video and Audio files just won't play. Zip files turn into an error when unzipping.

It's worth noting that I've nowhere reached the maximum 500GB limit on my Drive. At most I've only transferred 30GB's worth of files.

I'm transferring Music, Movies and series of Videos, as well as Zip files. So a mix of smaller and larger files.

It's almost as if there's an item limit on the amount of files I can transfer. Say the first 100 Items turn out ok. My devices can read them and I can transfer them to other devices no problem. But any item after that becomes corrupted(?).

And no, the drive itself isn't corrupted, I can still transfer and read the initial files that transferred successfully.

EDIT: Some extra bit of info that might shed light on what exactly the problem is. The latest video series i've transferred on to my Flash Drive. The first 7 Episodes are perfectly fine. BUT the 8th episode cuts off halfway and is unreadable and every successive file after that is too.

This can't be a coincidence anymore. I'm sure there is something about these external storage devices that I haven't understood.

Please what should/can I do? I'm trying to Backup a ton of files but these external storage devices keep failing. Is it a formatting issue? Did I use the wrong Memory Allocation amount? I'm absolutely clueless on this.

6885
 
 
The original post: /r/datahoarder by /u/Falcubar on 2024-09-02 10:54:54.

Hey All, I was looking on https://diskprices.com/ and noticed that amazon.com has cheaper prices. It seems to be better to ship from the US to the UK.

For example

US: Seagate 12TB Ironwolf ST12000VN0007 $129.99 about £98.98

UK: Seagate 12TB Ironwolf ST12000VN0007 £202.73

With shipping etc it comes to $166.29 which is around £126 which is still consderably cheaper than buying from Amazon UK.

Am I missing something, or have you all be doing this for years?

6886
 
 
The original post: /r/datahoarder by /u/ocassionallyaduck on 2024-09-02 10:04:26.

As the post title states, I'm thinking of ways to further reduce noise in my NAS build, and from most of the posts I see, I've taken most basic steps, and during my day-to-day it's honestly not that bad. But when the drives are doing some serious work, I'm wondering if there is anything I can do to dampen it a bit further, and the one I thought of was if anyone had tried putting a cushioning grommet between the backplane and the frame of the case. Because currently it seems like the drive couples directly to the case via the backplane, which is why some of the sound travels through the case.

I'm curious if anyone with this case has attempted what I'm thinking though, which would be to get some rubber grommets and fit them between the backplane and the case, so the HDDs would be floating on rubber mounts, and the backplane would as well, so the physical connection between HDD and backplane doesn't directly connect to the case.

As an extremely rough proof of concept, I suppose one could test this by merely removing the mounting screws temporarily and seeing if the noise was reduced by having a floating backplane.

6887
 
 
The original post: /r/datahoarder by /u/seriousplants on 2024-09-02 09:48:52.

Hey everyone, I'm working on a research project and I already realized that most of the tools to somewhat work with instagram data are dead. However, a few months ago I was at least able to search for more than one hashtag and get images with e.g. two specific hashtags as a result (e.g. #cat #big). Now that's not even possible anymore? I can only search for one hashtag. I'm kinda lost, I need a lot of data. Does anyone know of anything that's currently working? Thanks so much.

6888
 
 
The original post: /r/datahoarder by /u/youRFate on 2024-09-02 09:42:51.

I want a new NAS, my plan is to have 5 drives of 16-20TB each, in a raid 5 or equivalent ZFS setup.

Use cases for the NAS:

  • automated backups (restic)
  • sharing larger files with friends (nextcloud or similar)
  • media server (plex / jellyfin / or maybe just SMB shares as I do now)
  • photo backup and sharing (nextcloud or immich)
  • document storage (paperless)

The options I've looked at:

  1. Wait for the synology 1522+ replacement ==========================================

I already have a synology NAS which I've currently parked at my parents place. I use that for offsite backups (using restic), and for photo backup using synology photo. I also use synology drive

Pro:

  • nearly 0 maintenance
  • stuff like photo backup works ootb
  • I could connect synology drive on both NAS and they'd sync / load balance

con:

  • proprietary software
  • have to wait (heh)
  • CPU might have trouble transcoding media
  1. Buy some other nas (like ugreen DXP6800 Pro) and run a differen OS on them =============================================================================

pro:

  • I can customize it a lot more than synology
  • available now

con:

  • maintenance
  1. Build my own NAS ===================

pro:

  • can use a powerfull CPU with onboard GPU for transcoding in jellyfin/plex
  • probably cheaper

con:

  • maintenance

OS considerations

I run FreeBSD on a VPS I rent and on an rpi here which severs as a sort of shitty local media NAS. I like freeBSD for its stability and up to date packages.

I could run trueNAS, but they are moving away from BSD to debian, which I don't like as-is (old packages mainly), and if I then get debian through a 3rd party, it would probably be lagging behind even more...

Would running freeBSD on a ugreen or homebrew NAS give me a lot of downsides over using something like trueNAS?

6889
 
 
The original post: /r/datahoarder by /u/Emveey on 2024-09-02 08:42:07.

Hey everyone,

  • I have a Philips VR550 and a random VHS to USB dongle,
  • I selected the source in VLC,
  • When I insert the tape I get E1 then PLAY then it’s stuck on PLAY,
  • Sometimes I get a still image on VLC of noise or blue screen.

I tried it with 3 different VHS tapes.

Any idea what's going on? Thanks in advance!

6890
 
 
The original post: /r/datahoarder by /u/ObligationTimely168 on 2024-09-02 07:16:34.

https://archive.org/details/archiveteam_pixiv?tab=collection the files are in .megawarc.warc format so I have to download all 156.1TB of data to open it which I don't have that much storage and many more.

6891
 
 
The original post: /r/datahoarder by /u/FrancoCanzani on 2024-09-02 07:09:17.
6892
 
 
The original post: /r/datahoarder by /u/Aggressive-Bath-6190 on 2024-09-02 03:41:53.

Okay so i dont know ANYTHING about this sort of stuff. But i do know i want to back up my data now since i have tons of pictures and videos.

I think we have a seagate 1TB drive, And we do have a macbook so can anyone inform me about what i need to do, need to have, and stuff lol

6893
 
 
The original post: /r/datahoarder by /u/liebrarian2 on 2024-09-02 03:39:38.

Does DupeGuru work well for videos that are identical but were compressed differently? Some websites have different compression algorithms, and will even change metadata and file name.

First of all, would picture blocks work for video? Would exif work?

6894
 
 
The original post: /r/datahoarder by /u/ValuableAnswer on 2024-09-02 02:39:32.

So I have a old Kingston A400, can I use in a enclosure and use it as an external drive. The reason I'm asking this is because, some people say DRAMLESS SSDs are really the best for storage but not for using as you main OS drive, planning to just make it a storage for old family videos, and 4k videos.

6895
 
 
The original post: /r/datahoarder by /u/massivlybored on 2024-09-02 00:07:08.

I recently purchased a Synology DS1821+ maxed with 8x22TB drives. Surprisingly still have tons of space left, but I still occasionally look where I began all those years ago, at my 8TB DS411J, and wonder what to do with it, especially since it currently has my old movie collection on it, before I moved all of it to the DS1821+

Logically I would take the time, to go through it and (that dreaded word) delete, the duplicates or those files that are lower quality than updated versions, but I have not pulled the trigger yet, and I don't know what my hesitation is.

6896
 
 
The original post: /r/datahoarder by /u/Oneleg5 on 2024-09-01 22:50:13.

As an editor I often find myself needing to download reference material to sample in videos (sometimes just memes depending on the context)

but all these "to mp4" sites always spit out an .mp4 file that has invalid encoding, or something that won't agree with vegas pro. Just so frustrating that all of these sites can't give me a file that can be used in my editor.

6897
 
 
The original post: /r/datahoarder by /u/jailtheorange1 on 2024-09-01 22:36:42.

How do I split up 14TB external with NTFS, MacOS Ext, and ExFAT partitions?

I want 8TB for my PC with NTFS, 4TB for my Macbook with MacOS Ext (journaled), and 1TB for ExFAT as a dump drive for moving files between both systems.

I first attached my drive to the PC, setup an NTFS partition, and left the rest free space.

I then attached the drive to my macbook, and it doesn't see the free space under disk utility, only the 8TB NTFS, so don't see how to proceed. Am I missing something?

6898
 
 
The original post: /r/datahoarder by /u/tutebo88 on 2024-09-01 22:36:07.

Hi all,

initially, I had the impression that SnapRAID (by itself) worked similar to UnRAID or ZFS in that it pooled drives (mixed size drives possible) into one or more virtual volumes, managed the drives configuration, calculated parity and enabled some kind of resilvering (restore). Their website isn't totally clear on that.

But then I noticed that SnapRAID always (?) came up in conjunction with some software like mergerfs or DrivePool. This seems to indicate that SnapRAID itself does not do any drive pooling.

However, I don't understand how SnapRAID could do the parity calculation and resilvering (restore) operations without knowledge about the pool. The way I understand other mixed-drive RAIDs like Drobo's BeyondRAID or Synology's SHR work is that they calculate multiple (partial) RAID arrays according to the number and size of drives and combine them (with mirroring thrown in for the remaining two-drive parts) into one (virtual) array.

Or maybe SnapRAID only works on the physical drives layer, and leaves the pooling stuff to some kind of volume manager? I don't quite get how this could possibly work.

I'm pretty confused, can someone add some clarity?

6899
 
 
The original post: /r/datahoarder by /u/DylanToback on 2024-09-01 22:33:05.
6900
 
 
The original post: /r/datahoarder by /u/c00pdwg on 2024-09-01 22:27:28.

I’ll start: 1360:171

view more: ‹ prev next ›