The original post: /r/datahoarder by /u/DeadoTheDegenerate on 2024-05-27 01:53:30.

So I'm mostly looking for an OS (and potentially good community support such as forums/YT guides to help w this).

Requirements:

• Ability to connect to a custom personal domain (using DDNS to point from a subdomain to my NAS) for it to be globally accessible.
• Must be user friendly - preferably with a Web app/interface similar to DSM.
• Must be good for multiple users. High quality admin tools to assign quotas and folder access.

Currently my NAS is acting as a backup for a bunch of friends & family members, as well as a media server. Only problem is that my J-series is no where near powerful enough to even stream a show at 1080p... I would go with another Synology because it's way easier, but why get an R1600 and 4GBs of RAM when I can get a 3200G and 32GBs for £150 less.

If I could get something nigh-on identical to Synology's DSM from a general user-end view (like CasaOS) which can be accessed via Web while being NAS-friendly, that would be perfect!

Any help would be greatly appreciated, and if you have other advice for someone building a first-time custom NAS, then I'm all ears.

Edit: I forgot to mention that for connecting externally (not in Local Network), I'd really like to be able to use an SSL cert so I don't have to worry about the uNsEcUrE wEbSiTe warning haha. Set it up on my Synology a while ago but I've long forgotten how to do that by now

The original post: /r/datahoarder by /u/cheater00 on 2024-05-27 01:12:57.

I have a directory that's about 1 TB of files, and many of them are duplicated a few times over due to how they were acquired. I'd like to replace bit-exact duplicates with hardlinks. Is there a good tool for doing that? I don't feel very easy doing that by hand, and I feel like googling around could end up with crappy software, so I thought I'd come and ask here.

The original post: /r/datahoarder by /u/Pinguinina on 2024-05-26 23:20:15.

With a PC or Mac for regular files, etc.

It has Xbox branding and is bigger than the "PC/Console version" so I don't know if it has some sort of formatting or block built into it that prevents it from just being used as an external.

I've had the 8TB for a while but I need more space. It's reasonably portable considering the size which is something I need and as far as I'm aware it includes a good drive. I'm open to alternative suggestions though but it needs to be portable and not really more expensive.

The original post: /r/datahoarder by /u/Alert_Judge2935 on 2024-05-26 22:44:24.

I've got one of these coming really soon. It has RAM upgrades to 32MB and a 10Gbe network card.

I'm thinking about 12 TB drives in it. I have about 70TB of stuff to move across...

I'm looking at RAID6 and one volume. I've read that some people grab drives out of WD elements external drives. Is this a good idea? The NAS will be in a study, so noise isn't that important, but prefer quiet!

Is buying them secondhand on eBay a good idea? They seem pretty expensive...

I have 4x14TB ironwolf drives in a current NAS. I think I can add these to a RAID6 once I've set it up with 8 drives.

Should I use larger drives and not use all the bays?

Thanks for any help

The original post: /r/datahoarder by /u/original_account_nam on 2024-05-26 22:32:47.

I’ve kept almost every bluray / dvd / uhd I’ve ever bought. I want to create some sort of digital inventory so I know exactly what I have.

Trouble is, in some cases, I have multiple versions of the same film. UHD/BD. Directors cut / theatrical cut. Etc

Double trouble: I don’t have all the cases either. Some are loose disks. That makes things like UPC difficult

What ‘columns’ would you add to the database. What metadata do you all track for your physica media collection? What naming convention do you follow for digital backups?

The original post: /r/datahoarder by /u/instagigated on 2024-05-26 22:23:28.

Thoughts on using drives manufactured some years ago? Is there greater risk of data corruption/loss vs. using drives manufactured in the past 12 months?

I received two drives recently:

• Sandisk 1 TB portable SSD (2021)
• WD 16 TB external HDD (2022)

Should I return and get something manufactured more recently?

The original post: /r/datahoarder by /u/SpatulaFlip on 2024-05-26 21:58:43.

May be a dumb question but I’m in the process of planning out my build for a home server/NAS and was looking at PC cases that can hold a decent number of drives.

Why do PC cases have slots for both 3.5inch and 2.5inch drive mounts? Do people generally use both kinds in their systems? Or is it more of a space thing? Thanks 😅

The original post: /r/datahoarder by /u/eldomtom2 on 2024-05-26 21:41:04.

I'm using Save Page WE at the moment, is there a good reason to switch?

The original post: /r/datahoarder by /u/HArgHorp on 2024-05-26 21:15:42.

Hello!

So, I own a collectors edition for a video game, this video game has a strategy guide that I wished to put in the box, but it’s too big.

So I had the idea of putting files, most likely PDF forms of the Strategy Book, other guides, and maybe short video trailers of the game (and maybe some gameplay) in some form of physical storage and keeping it in the box, so many years down the line I could open the box, plug in the device, and watch the videos and read the books to understand what the game was (especially if I no longer have the means of playing the game, it’s Fallout New Vegas)

I initially was thinking of a Flash-Drive / Pen Drive. I just found one sitting around which is 32GB and it could work (hasn’t been used since 2018 though) but I heard that Flash-Drives apparently deteriorate over time, which would be inefficient for the whole purpose of archiving these files about the game for future use.

Apparently there’s other options I could try, maybe I could still use Flash-Drives but just copy the files from one drive to a new one every couple years (depending on how long it lasts, will be expensive though) or External SSDs but I heard they deteriorate by 10 years though as well.

I’m kind of stuck now on what to do for this archival purpose. I know everything probably fails after time, especially digitally, but if there’s some form of long-term storage where I only have to copy to a newer device after a considerably long time, that would be nice.

You guys probably know a lot more about this than me though, I’m interested to learn and hear any of your ideas on what to do! Thank you so much and have a good day!

The original post: /r/datahoarder by /u/Ezmiller_2 on 2024-05-26 20:43:08.

OK, so I have two rack servers --an IBM/Lenovo 2008 or so X3550 and also a Lenovo X3550 M5, both 4 drivebays. They both function perfectly.

The IBM x3550 is much more relaxed at what I throw into it...I believe the backplane or drivebays are hotswappable. Throw a drive in or take one out and it keeps ticking.

The Lenovo is much quieter than the IBM, and has faster. cheaper DDR4 RAM. It also has USB 3.0.

Both were ebay purchases, so you get what you get. Both use 2.5" drives, but my Lenovo can use 3.5" as well. The IBM doesn't have the BIOS/UEFI password problem that the Lenovo has. I bought it used, and did not receive the password. As a result, changing BIOS settings is a pain. It must be locked down at the UEFI settings, and I read that once the password is set, there is no resetting it.

I also have a Lenovo M72E SFF that is gathering dust in my basement. It functions perfectly. I really would like to use this model as it's quiet and very power-conservative vs my other HTPC, which is an AMD Phenom II X6-1050T or 1055T build I did myself. I started experiencing glitches with the AMD build recently, so I'm thinking maybe not using that one. I don't like the case either. The problem with my M72E is not enough expansion space for anything really. I could transfer the board and hope that it fits in a bigger case. Also, no native USB3, so minus one PCI-E slot for that. Also I have a PNY or Gigabyte 960 2GB fanless GPU in the GPU slot. So it's a bit tight. IIRC, I have one more PCI-E slot available, but they are half-size slots. Also PCE-E 1.x speed.

I have a WD 4TB external USB drive I've been holding everything on right now. All of my ripped media is on it. I also have 4 500GB SSDs, I have an HP P420 1GB FBWC and the battery that goes with it. I also have an IBM 46M0851 Raidserver card without the cables. I realize I need to buy the cables and battery if I am to use that. I also have a WD Blue 3.5" 4TB sata HDD 7200RPM I have available.

I'd rather go on the cheap side of things. I've asked on r/homeserver and r/homelabs a couple of times what to do. One person suggested using a Rasberry Pi, but I'm not sure how far out they are on supplies. Also I'm not pleased with how their original plans have not taken off the right way. And also how they treated the supply chain issue during the pandemic.

I was considering a SAS JBOD container, but want to save money and also not create more space taken up by my tech hobbies lol. I do want to future proof, to a point, my media collection. So 8TB would be more than enough for right now. I do use Linux daily if that helps. And I am familiar with the BSD OS to a point.

I live by myself and own my home, so I'm not afraid of using a room to store stuff for now. I have my rack servers in my basement currently turned off. I would like to minimize noise if possible, but I also understand how server fans work and they create noise. I'm not against a new build necessarily. I just would rather not spend a lot of money.

Also I'm in southern Idaho, so....everything I do will have to be shipped. The closest place that has anything is in Boise, and they didn't have much when I went looking a while back. Where I am at is mostly agricultural businesses.

The original post: /r/datahoarder by /u/Adorok on 2024-05-26 20:42:00.

i currently have 2x 16tb hdds in a mirror + a seperate disk for weekly backups (full backups, i dont want incremental backups), and the space is slowly running out. Buying bigger drives would be more expensive, than just buying 3 additional drives. I have a spare server, splitting between servers would only increase the power bill.

By putting them in a mirror, i could increase read speed and have a lower electricity consumption. On the other hand, if my psu fails, all drives could theorethicaly fail at once.

What do you guys think / would you do?

The original post: /r/datahoarder by /u/McFlyParadox on 2024-05-26 20:05:15.

I am just starting work on my first DIY NAS. It's going to either run Plex directly, or host files for Plex (still figuring that part out). I selected the Silverstone CS382 for the case, because I liked it size; that it had 8x hot swap drive bays; has a slot for a slim ODD so that I can do some limited BDR rips for cold storage; and that the motherboard tray is inverted, potentially allowing for full-length GPUs if I decide to run Plex directly (I end up transcoding a lot because I need subtitles on). The only thing I don't really care for is that the largest motherboard it can accept is mATX, which has less to do with the size and more to do with current trends that exist on modern mATX boards.

Basically, most modern mATX boards seem to sacrifice SATA port count in favor of dedicating the PCIe lanes to NVMe slots instead. I get it: between their speed and lack of cables, NVMe are pretty neat (*rim shot*), but not really what I need for this build. It seems that most mATX boards top out around 4x SATA ports (LGA 1700 Intel mATX boards seem to top out at 4x; some AM5 AMD mATX boards will go up to 6x, but most are 4x), and instead offer 2-3x NVMe slots instead. So what I am wondering is this:

Has anyone tried using SATA add-on cards in a situation like this? Not a RAID card, just "here is some SATA ports and a chip a tie them into the PCIe lanes".

I've found a couple of items like the Vantec M.2 PCIe Gen3x2 to 5 ports SATA III expansion card that look like they might get me up to 9x SATA ports, which will be enough to get me my 8x hotswap bays operational and the slim ODD drive. But what I am concerned about is that 4x of the SATA ports will be "proper" ones on the motherboard and 5x will be "add-ons", and I am not sure how that might affect a RAID 5 or 6 array.

Side note that may change people's answers: there is a non-zero chance that if I decide to run Plex directly on this box, I may just make it a server running Ubuntu or Windows instead, and figure out either a software RAID 5 or 6, JBOD, or just plain drives and remote backup.

The original post: /r/datahoarder by /u/jkkpr on 2024-05-26 19:44:56.

And the friend needs help.

Apparently, the friend formatted a 16 TB drive on windows, and it worked at the time and put lots of data on it. Then after reboot doesn't work on windows. And doesn't work on Linux either. (No allocation tables?)

I'm using Ubuntu 24 and can't get it to mount. It reads and acknowledges that the drive exists, but not sure how to get the data off of it. Various instructions to mount as a NTFS drive have not worked. Also tried asking nicely, and was met with a low grumbling sound.

any help? for the friend, I mean. Because I would never do anything that stupid.

Edit:

16 TB Western Digital. Hooked up to a USB enclosure, drive itself is good, just formatted it wrong to begin with.

I tried test-disk as suggested, didn't show a partition for NTFS or various FATs.

The original post: /r/datahoarder by /u/sammorrison9800 on 2024-05-26 19:33:55.

The original post: /r/datahoarder by /u/admin_NLboy on 2024-05-26 19:25:35.

https://github.com/nlboy1/.album-filetype

meet a tinyy new project of mine: .album, pretty simple, its just a renamed zip file which vlc can open, i think this can help some people out there who are juggling with 100+gb of flacs/mp3s or even wavs (me lol). so uuh please ggive feedback

The original post: /r/datahoarder by /u/SylvieSerene on 2024-05-26 18:09:29.

In 2017, apparently the government banned it. But I really need to upload a lost media anime movie inorder to preserve it (I managed to download it before it was wiped off the internet due to copyright). I used a VPN but archive.org doesnt open up since "it took too long to load" but you need an account to upload

What to do?

The original post: /r/datahoarder by /u/Empire_Fable on 2024-05-26 17:34:51.

Good day every one. Thank you for letting me in the community. I just started dabbling with archiving data

I'm currently archiving some rather big compressed files 200+ GB. Weighing some options. I considered buying a HP LTO 5 class tape drive(Its more in my price range then the newer ones) . Looking at the Tape media cost, I'm seeing maybe a better option to just get a bunch of hotswappable 2.5" 1.2Tb SAS drives for a older HP dl360. Then just hot swapping them out like tapes. I really did want a tape drive though. Any one know of a good benefit to a tape drive other then them being super cool?

The original post: /r/datahoarder by /u/vanillapenguins on 2024-05-26 16:29:53.

The native codec of the video is DV25, which is neither lossless or open. For preservation purposes it would be better to transcode the video to FFV1 or another codec that is lossless, open source and commonly used.

However, I have read that transcoding from DV25 does not guarantee that the technical metadata is preserved. That is data of about the camera, recording date and time, and video settings. I guess this depends on the settings - but since transcoding is more about the pixel data (?) it might not cover this extra metadata?

Would you recommend me to archive the video in the native codec or transcode to a more preservation-friendly format?

The original post: /r/datahoarder by /u/Breeze23412 on 2024-05-26 15:46:07.

I recently bought a QNAP TL-D800C more or less by accident. I had thought what I was buying was a NAS but which ended up being a DAS. It has USB 3.2 Gen 2 connectivity, which is neat, but kind of defeats the purpose I was hoping to use it for.

My question: if I were to buy a 2 bay synology NAS would I be able to utilize the 8bay DAS with the 3.2 Gen 2 usb connection? I would basically have 10x drives at that point and be utilizing the NAS with attached storage.

This is my first time building / buying a NAS and I'm definitely stumbling through it. Any suggestions would be helpful, thanks.

The original post: /r/datahoarder by /u/sqenixs on 2024-05-26 14:02:18.

I would like to have multiple copies of my data in different geographical locations around the world.

The original post: /r/datahoarder by /u/tddammo1 on 2024-05-26 13:52:38.

Hi all, learning *much* more about RAID etc now that I'm upgrading from essentially raid 0 across 3 pi's into a new system that has the potential for 13 drive bays (at some point).

As I'm learning, I want to verify I understand (some) of how the interaction of RAID 6 and the 3,2,1 rule can be applied.

I'm perfectly okay with if this idea is wrong, and that's fine.

Assumptions: All raid drives are 1TB, running RAID 6, using 4 drives

3 Copies

1. Obviously the first one is RAID 6 1TB, allowing for 2 TB storage, 2TB protection. (HDD)
2. Second backup: Should this be *another* RAID 6 node? Or can this be a single 2TB drive (SSD)
3. Offsite backup: Similarly, can this be a 2TB drive

Essentially when using 3, 2, 1 rule should we be mimicking RAID? Or is it safe to have these drives be single drives (yes, now we've gone from double redundancy to single point of failure, which is why I'm asking)

Thanks!

The original post: /r/datahoarder by /u/cyong on 2024-05-26 12:38:26.

Its time to re-evaluate the backup situation. My previous offsite backup (relatives place remote server) is no longer an option. So its time to evolve.

I have about 250TB Unraid that I think I should take to a LTO setup. (Somehow...) And what I am thinking I want to do is to have some tape that I backup to once (or twice) a year and store offsite... and then another set of tapes that does more of a monthly backup and stays onsite.

Given the amount of data I think LTO makes the most sense. But I honestly have no idea what to look for hardware, or software wise, or how to approach the matter in order to accomplish my goal. Do i need a desktop drive connected to PC running software there? Or a tape library in a rack? or????

The original post: /r/datahoarder by /u/Ben4425 on 2024-05-26 11:12:04.

I recently rebuilt my NAS by moving it from a Fractal Node 804 case into the Sagittarius NAS case available from AliExpress. The Node 804 was a good case, with great temps, but swapping hard drives around was a pain. The 804 is also ginormous.

So, why the Sagittarius? It met my requirements for MATX, eight externally accessible drive bays, and what appeared to be good drive cooling. I also considered:

• Audheid K7. Only had two 92mm fans and some reviews reported high drive temps. Also required buying a Flex PSU.
• Audheid 8-Bay 2023 Edition. Provides better cooling with two 120mm fans but still required a Flex PSU if you wanted all 8 drive bays.
• Jonsbo N4. Only 4 bays were externally accessible and it only has one 120mm fan.

Overall, I'm happy with the Sagittarius case. Its very compact yet it holds 8 drives, an MATX motherboard, and four 120mm fans. My drive and CPU temps are excellent.

But, you really need to plan your build because there's no documentation, no cable management, and because some connectors are hidden by other components. If you don't plug in your cables as you build then you'll never get to them later after the build is complete. You also need think about air flow which I'll discuss after documenting my build.

Time for some photos, starting with the empty case.

Empty Case

The two small rectangular holes in the upper and bottom left are all you have for routing cables from this, the motherboard side, to the hard drives on the other side. I ran 4 SATA cables through each of these holes.

My motherboard mounts 4 of its SATA Ports along the edge so I had to plug those in before installing the motherboard itself. Otherwise, those connectors would have been practically inaccessible:

Motherboard Edge Connector Issues

The case supports two 2.5 SSD drives that are screwed to the bottom of the case. But, if you do, they will be flush to the case so plugging in cables will be near impossible. I purchased some 1/4" nylon standoffs and longer M3-10 screws to elevate the SSDs a bit. It was still a pain to plug in the cables (because they are toward the bottom of this photo) but it worked:

https://preview.redd.it/31oe40fbxq2d1.jpg?width=3000&format=pjpg&auto=webp&s=56a12c7afa4be19ee9ec78f20c76af5b46770de9

I routed all my SATA and fan cables next. I have 10 SATA ports total, two for SSDs and 8 for HDDs. Four of those interfaces are on an ASM-1064 PCIe add-on board and the rest are on the motherboard.

Then, it was time for the power supply. I strongly suggest using a modular SFX power supply that typically comes with shorter cables. Long, or unnecessary, cables will be an issue because there's no place to put them. Also note you should plug in the EPS power cable before you install the power supply because you'll never get to it afterward:

EPS Power Connector

Also make sure you route the SATA power cable before installing the power supply.

Last, install the fans. Standard 25mm thickness fans just barely clear the main motherboard power cable at the bottom of this picture. Also note I installed fan grills on all my fans otherwise (for my airflow) the cables would have hit the fan blades:

Finished Interior

Now, about the "drive sleds". This case only provides rubber bushings and screws to fasten those bushings to the sides of your hard drives. They also provide a metal plate with a bend that acts as the handle to pull the drive from the case:

"Drive Sled"

This is really basic but I found it works well.

Wrapping up, here's a photo of the finished product. You can see the slots on the right that hold the rubber bushings that are attached to the hard drives.

Final Result w/o Drive Bay Cover

I installed four 120mm Phanteks fans (from my old Node 804) into this case and all of them are configured to exhaust air from the case. There are two behind the grill on the left of this picture and you can see that the fan screws just go through the grating holes. Air for the left side of the case is pulled in through holes in the rear and a large grating on the left side of the case (not visible here). So, on the left, air is pulled from the side and down towards the CPU and motherboard before exhausting out the front.

On the right, there are two fans behind the hard drive cage. They too exhaust air that is pulled from the front of the case, past the hard drives, and then blown out the rear. There's maybe 5mm space between the drives so airflow is unimpeded. At 22c ambient, my idle drive temps vary from 24c to 27c. Not bad!

As I said earlier, I'm happy. The case is very compact (about 300x260x265 mm), holds eight 3.5" drives, two 2.5" SSDs, and runs cool. For about $180, which included shipping to Massachusetts, I think it was a good purchase. That said, it isn't perfect:

• No cable management features.
• No fans are included, you must provide your own.
• Standard ATX PSU are supported but IMHO are impractical due to the larger PSU size and longer cables. Cable management would be a mess.
• FYI, the case has one USB 3.0 Type A port and one USB-C port on the front. Both of these are wired to the same USB 3.0 motherboard cable so the USB-C port will be limited to USB 3.0 speeds (5 Gbps). I.e. the USB-C port is wired to a USB 3.0 port on the motherboard.

The original post: /r/datahoarder by /u/stevecondy123 on 2024-05-26 11:00:18.

Someone's trying to track down when a 1GB HDD would have cost $100. Figured this community may know.

https://news.ycombinator.com/item?id=40446887

The original post: /r/datahoarder by /u/KitezhGrad on 2024-05-26 09:03:45.

I added quite a few Instagram pictures to my Saved that are now unavailable to me likely because the accounts that posted them were set to private and I neglected to follow them while those Instagram accounts were open.

I'd like to know the account usernames that my unavailable saved Instagram posts came from so I can request to follow those accounts. Is it possible? Thank you for looking into this.