It's A Digital Disease!

The original post: /r/datahoarder by /u/No_Tip1785 on 2024-08-04 19:48:45.

I read some posts of people saying to use YouTube but i'm scared that the videos will get deleted in the future and compression/quality problem. Is there anything besides physical storage?

The original post: /r/datahoarder by /u/yourd00m on 2024-08-04 19:48:41.

I am a student currently preparing for engineering and I have found a beautiful telegram channel which has all files that I need. The problem is I want to store only selected files on my pc which Is not possible by the chat export option(which is not even showing). The channel is private (I guess), I can only copy the link for the msg which has the file. There are several files like this which are sent as msgs and pdfs. Is there any way I can dl these files from the post link by any bot or windows client? Any help would be appreciated. Thanks.

The original post: /r/datahoarder by /u/next on 2024-08-04 18:48:00.

Hello,

I'm looking for a NAS device and/or software. While I can handle installing and configuring things like this on e.g. Raspberry Pi boards, I would prefer an out-of-the-box solution. I have straightforward requirements: my family consists of six people who live in separate locations, and we all use Apple products.

I'd like to have two NAS devices, one at my house and one at another house, to serve as backups for all our Apple devices with full data redundancy. If one server fails, gets damaged, or is stolen, I want to be able to fully recover from the second server. Additionally, I don't want to share all my data, such as personal photos, with others, so I need a solution that supports sharing with specific permissions.

Besides storing backups of Apple devices, I would like to push some media files, like movies, to the NAS. However, it doesn't need to be powerful enough to stream these files.

I know that devices like Synology support such setups, but I'm unsure if Synology is the best option for my specific requirements. And worth it. Could you recommend a suitable solution?

I would appreciate any recommendations. Thank you!

The original post: /r/datahoarder by /u/Sir-SgtSnafu on 2024-08-04 18:37:14.

I have some innards to 20tb WD Element drives, Would the board be handy for anything? How would you make use of?

The original post: /r/datahoarder by /u/JaredKFan77 on 2024-08-04 18:29:11.

HI all,

Is it just me or is the download speed at the Internet Archive continuing to be abysmal? I'm often getting speed of like 50 kb/s and I have roughly a 100 MB/s connection according to speedtest. Been using the IA command line utility for downloading of entire collections. Sometimes the speed will end up around 11 MB/s which is about the fastest it can download, but right now it's glacially slow at the aforementioned 50 kb/s which makes downloading ANYTHING a chore you end up waiting hours to finish. Is there any way I can improve the download speed or am I just stuck with it being dial-up level slow?

The original post: /r/datahoarder by /u/Ashamed-Log-4955 on 2024-08-04 18:04:21.

I tried transferring some videos I had downloaded (from YouTube and Tik Tok using converters) to my SSD to free up some space on my phone; however, I noticed that the dates on the files had been changed to the date I transferred them to the SSD. Is this a normal occurrence? Or is something wrong with my SSD or even my phone? Or am I just transferring the files incorrectly? If so, how could I go about transferring my files to the SSD while retaining the original dates? Should I use a computer? Transferring them to the computer first, then the SSD?

The original post: /r/datahoarder by /u/Flawed_L0gic on 2024-08-04 17:56:52.

Got sent this by a family member, alarm bells immediately began ringing.

https://www.techradar.com/pro/this-16tb-ssd-nas-is-so-small-it-fits-in-your-backpocket-and-yet-it-packs-a-full-fledged-arm-pc-has-a-battery-delivers-personal-cloud-storage-and-can-even-transform-into-a-wireless-drive

Immediately, there's no way you're getting 16TB of SSD storage for that price. Not even close. You're looking at 3-4x that for storage alone.

But if you assume it's not shipping with any storage at that price... it gets a little more feasible?

Their specs say Rockchip RK3588 CPU, ARM Mali-G610 GPU, and 8GB RAM - a bit of searching leads me to this amazon link for a ~$200 dollar single board computer with CURIOUSLY similar feature listings to what's on their site. Throw in a battery, custom chassis, and manufacturing, and it probably wouldn't be far off from that 400 dollar mark.

~~One problem - the chip in question only has a single storage interface, which according to the spec sheet can only be used as either SATA 3.0 OR PCIe 2.0 (graphic says 1 lane), which if I understand correctly, means a maximum of ~600MBS throughput.~~ (Edit: I used the wrong spec sheet. This lists up to 4x PCIe 3.0 lanes. So maybe it's decent?)

So worst case scenario, it's vaporware, best case scenario, you're spending over a grand for a box that can't do any better than a SATA drive.

The number of features they're claiming to offer on their site doesn't really make it much better. But I dunno. Maybe I'm missing something.

Thoughts?

The original post: /r/datahoarder by /u/NateTheGamingNinja on 2024-08-04 17:39:37.

Hey everyone, this is sort of aimed more towards discussion rather than a question, but I was wondering how your experience with an HDD over a SSD for storage (especially mass storage) has gone? How often do you run into issues with them, and is there a reason why they are still somewhat prolific in this community, even if SDD's continue to get more advanced?

Kind of asking cause I'm a "small-scale" datahoarder myself who's currently running into issues with my 1TB HDD (which I plan on getting replaced before any worse can happen). Granted, I got it for free and even still, its a cheap one.

I am also running a 1TB M.2 as my C: drive and a 250GB 3.5 SSD for games, which haven't thrown nearly as many issues at me as my HDD has. I'm also considering expanding these drives to something larger. On that note, any recommendations?

The original post: /r/datahoarder by /u/scndthe2nd on 2024-08-04 17:22:04.

Howdy!

I'm looking to build something dumb, specifically, an injestion device using a sata port Multiplier like the one below, a usb to sata adapter, along with some fiber board, a few dvd drives, and an atx power supply, and maybe a handle?.

https://www.amazon.com/dp/B0BYNFR2FC/

https://www.amazon.com/dp/B00WQJ851O/

Question: What would I be looking for in a usb to sata device that would support this? Is there a better way to have 4 or so dvd drives hooked up to usb for cheap? Should I look into getting an external laptop power supply instead of using an atx power supply for this?

Note: I did a similar cross post to r/homelab. I found a few diy devices that people made in the past, but they tended to use multiple usb to sata devices and multiplex from the usb side. They tend to be cable-heavy, and require multiple power supplies. I'd like this to be desktop sized.

The original post: /r/datahoarder by /u/forzafan263 on 2024-08-04 17:12:04.

What do you guys recommend to your friends and family for storage solutions? These people tend to be hardware challenged and don’t really care to learn too much about keeping their data safe but say to me “oh my phone is full I just had to delete 2000 pictures” and then I ask if they have a PC and they go “that is full too” lol

External HD? Or cloud? Or just give up?

The original post: /r/datahoarder by /u/Ashamed-Log-4955 on 2024-08-04 14:55:52.

I've been trying to back up photos and videos from my phone to a SanDisk 1TB portable SSD. I noticed when I copied and pasted them from my phone to the SSD that the dates would change and be updated to the date they were transferred across to the SSD. In my hastiness this morning, I tried a different method. I tried cutting and pasting some videos from my phone to the SSD to free up some space. However, I noticed that even though I cut and pasted the folder from my phone to the SSD, the modification dates and creation dates were updated. I verified this on my laptop. I tried sorting them in all the ways that I could, but it seems that all the dates were changed. My question is, how do I prevent this? How do I transfer my files from my phone to my SSD without changing the dates, and I guess my secondary question would be, Can I recover the dates from the videos I transferred this morning, or is that data lost? And if I can recover it, how do I go about doing so?

The original post: /r/datahoarder by /u/Citrus4176 on 2024-08-04 13:23:46.

I am just entering the world of data storage and am planning out my first NAS and backup solution. During this, the estimations for the amount of storage I will need seems, well, wrong? Below is an example to illustrate:

Say I estimate that all of my working copy of data for my household will occupy up to 4TB of space. I also would like to utilize RAID1 and abide by the 3-2-1 backup rule. From my understanding, the following applies:

• 1x4TB drive for the initial storage of the RAID1 array in my NAS.
• 1x4TB drive for the mirrored storage of the RAID1 array in my NAS.
• 1x4TB drive for the onsite backup of the initial storage (because RAID is not a backup).
• 1x4TB drive for the offsite backup of the initial storage.

So to properly architect my up to 4TB of data, I would be buying 4x4TB = 16TB of drives.

I get that data redundancy is the goal, but this doesn't seem right. Am I improperly estimating the size of backups or how much data there really will be?

Thank you.

Edit: to summarize some of the points commented below:

• Consider whether RAID is needed for basic home storage and the importance of data downtime, as RAID is often a strategy for more enterprise solutions.
• Consider the costs of cloud storage versus physical storage for an offsite backup.
• At minimum, one backup is needed for basic data safety. Past that, the complexity depends on the importance of data.

For my case, I am a basic home user. My most important data is picture, document, and 2FA backup storage, which is only a portion of the overall data. Data uptime is convenient, but I will not be storing critical resources on this device that would freeze my day to day operations. I do not live in an area where the threat of burglary or natural disaster is significant.

Considering this, having a set of two drives (one main storage, one backup, no RAID) or having a set of three drives (two in RAID1 and one backup) may be more reasonable.

The original post: /r/datahoarder by /u/GetInHereStalker on 2024-08-04 13:19:30.

Just wondering. Obviously there is the 25mb email limit, but in theory you could take a 1 gb file, 7z it to 40 25mb parts, and email it to your yahoo email. 1tb free storage! Not very convenient, but good for old rarely used stuff and it's 1tb free from a reliable email provider that is not going away any time soon.

The original post: /r/datahoarder by /u/DanceMyth on 2024-08-04 12:15:10.

Hope this is allowed - a late family member has extensive photography work in various file types across multiple volumes (disk drives, dvds, etc). Some are dedicated and others are buried in Time Machine backups.

Other than needing to obviously grab files from each disk - any method you’d use to try to make sure you can find any stragglers? This may be a question for ask programmers but thought I’d check here to see if there are any best practices when trying to consolidate and back up distributed data.

The original post: /r/datahoarder by /u/jaeqkr on 2024-08-04 11:22:05.

Would it be possible to extract the 3d model files of some of the buildings in this website? (3D buildings enabled from "View Catalogue" > "Buildings" > "VicMap Buildings" > "Buildings with Roof Details (Melbourne)") Needing a couple buildings for site context modelling in my architecture project, so won't be for commercial use.

https://digitaltwin.vic.gov.au/public/

The original post: /r/datahoarder by /u/Soeroah on 2024-08-04 11:11:29.

Hi,

For the last few months I've been using Robocopy to make sure any changes I make to files in my drives - title changes, metadata changes, replacements etc - are cloned over to a back-up drive.

However, for the first time today I noticed it removed a few dozen files it termed "Extra", but in my auditing I can't find what they would have been replaced with.

I'm going through the log file and trying to compare things one at a time - it's taking quite a while.

I was wondering if there's a way to have Robocopy print a deleted file's metadata to the log file? At the moment it prints the location it was deleted from and the name of the file, but it'd be a big help if it also printed the tags or comment fields.

Thanks.

The original post: /r/datahoarder by /u/b3czka on 2024-08-04 08:53:25.

I'm wondering if there are any DAS out there that wont trigger all HDDs in their bays to spin as soon as I make a read request to just one HDD located in them?

So far I've had only simplest 2-bay/4-bay docks (the docking station ones) and I noticed that browsing just a single disk content will spin all disks anyway, which is kind of irritating and unnecessary.

I know there are solutions with physical power on/off buttons, but I want HDDs to be available and ready on demand, yet not to go out of sleep mode when it's not needed.

Is anyone familiar with solutions to this? Im eyeing Mediasonic PROBOX 4 Bay and Sabrent DS-SC4B so figured I would ask here before I order them blindly to test.

EDIT: Obviously setup is non-RAID/JBOD, plain simple individual storage one.

The original post: /r/datahoarder by /u/Flutter_ExoPlanet on 2024-08-04 08:07:48.

Hi,

I was wondering if there was a discord or anything else related to r/DataHoarder?

Also, wondering if there are other communities focusing somehow on data hoarding, similar to this one?

The original post: /r/datahoarder by /u/Flutter_ExoPlanet on 2024-08-04 08:05:17.

Hi,

I am not looking into way to scrap whole reddit, instead I just want to be able to store "new posts".

Could you redirect me into methods on how to do that? Perhaps it was already discussed and people established good methods?

Furthermore, I would love to find some "archives" or similar for previous posts, for my favorite subreddits. If that ever exist?

The original post: /r/datahoarder by /u/Ninjulian_ on 2024-08-04 06:57:42.

purely hypothetically, if i had a DAS/JBOD, that's nothing but a SAS-expander and a bunch of HDDs supplied with power, with an external SFF-8088 connector or something. and if i then also had two servers with HBAs and i.e. mirrored truenas systems. is there a way i could set all that up in a way, that when server 1 shuts down or fails for some reason, server 2 boots up and takes over operations?

The original post: /r/datahoarder by /u/nameExpire14_04_2021 on 2024-08-04 06:04:21.

The original post: /r/datahoarder by /u/brixtonwreck on 2024-08-04 05:59:09.

After he was convicted of child pornography offences the BBC has begun removing content featuring Huw Edwards from its archives. The article says they're starting with family and entertainment content. Obviously a complicated situation given his reprehensible behaviour, but thought it worth mentioning here.

The original post: /r/datahoarder by /u/frobnosticus on 2024-08-04 05:20:57.

Okay. So this has GOT to be a "default formatting options" issue.

I've got a 14t I've installed in a gang usb enclosure and am pulling 1.6t off my NAS to back it up on the new platters.

At about 1.1 it puked saying the volume was full.

Virgin disc.

What the what?

I formatted it exFat with defaults through Win11, hoping to avoid compatibility problems when I finally get off my keister and hang it off a linux box.

I remember in ye olde days how you used to have to be careful about inodes taking more space than small files themselves, leading to a disc bloated with more directory entries than content.

But this is pretty dramatic even for that.

I've been doing this a long time and have never seen anything THIS extreme before.

What'd I do?

EDIT: I just reread that and it seems incoherent.

• Newly exFAT formatted 14t drive. 12.7t available on partition.
• Started a 1.6T copy off the lan.
• At 1.1T it died. The disc was full.
• Que?

The original post: /r/datahoarder by /u/LieVirus on 2024-08-04 04:41:54.

I was trying to pull data from a failing SSD with a 2-bay hard drive cloning dock, and the power went out. I do not live in a stormy area, a city serviced by PG&E (where power cuts happen due to aging transformer failure 3-5x a year). Next time I attempt this, I will be using a laptop and a USB enclosure, so the laptop battery can kick in during a power cut.

Now I have multiple planned cloning operations involving 3.5” HDDs in the future, which could take days due to the drives age or size.

While I could buy a small Jackery power bank and plug my 12v power supply into it, I am on a shoestring budget so I am looking for a Lithium Ion battery pack able to supply a regulated 12V and 2A constant amperage for 3 hours. I have a Talentcell 100Wh battery pack (link in the URL field of this post), and its voltage output is variable based on it’s state of charge. If there is a lithium battery pack on the market able to supply -tightly regulated- and -stable- 12V, I have not found it.

Another solution I identified is to plug in a DIY connector with a in-line output voltage regulator module. Could somebody recommend a 3A rated (1 Amp overhead for longevity) output voltage regulator module which can take the 9-13V from my Talentcell and output a stable, regulated 12V +/- .1V and 2A? I could use this homemade connector between it and the 2-bay hard drive cloning dock.

Either one, buying a lithium-based battery pack with tightly regulated and stable 12V output or the right output voltage regulator module would be a solution to my problem.

The original post: /r/datahoarder by /u/bamronn on 2024-08-04 04:41:44.