The original post: /r/datahoarder by /u/SpaceBoJangles on 2024-07-29 14:06:13.

I take photos on my iPhone and transfer it to my PC as HEIC. I’ve found that I can change the file extensions to .png and have it convert within the windows 10 file explorer, no programs or online services needed.

Does this do anything to the file or is this a viable solution for conversion without losing important data (HDR, metadata, quality, etc.)?

The original post: /r/datahoarder by /u/nbtm_sh on 2024-07-29 13:42:41.

Hey everyone. I recently built a new NAS and I feel I've done everything right. I got NAS drives, and got SSDs to act as a metadata device.

Granted, my NAS is under heavy load right now as it's completing a backup, but using my NAS in the Windows file explorer is impossible. It can take upwards of 10 seconds to list a directory

I'm running ZFS on Debian 12, so I ssh'd into the box and started poking around. I found that when I cd'd into the ZFS mount, and ran ls, it was fine and extremely fast. Cat'ing files was also very fast too. But on Windows they take forever to open. I have Ethernet in the walls of my apartment so all my devices are linked at 1gbps. My NAS has 64gb of RAM and only 32GB is being used right now. VMs running on the NAS connected via SMB are also very fast (Nextcloud, Soulseek, etc.) When I start copying files to my local machine from my NAS, I see the speeds i'd expect to see (~70-100mb/sec)

Why is this? Am I doing something wrong?

The original post: /r/datahoarder by /u/thismuch on 2024-07-29 13:18:42.

Hi, I have a client that has 500 terabytes of archival footage on their servers. What do you advise for backing it up? Do you recommend building another server? Thanks

The original post: /r/datahoarder by /u/htrapanime on 2024-07-29 11:53:26.

I was wondering on how to survive if internet went down but then this thought crossed my mind. So currently I'm building an offline browser but it will need data so tell me. Makes no sense but please play along

The original post: /r/datahoarder by /u/Dramatic-Race-2096 on 2024-07-29 11:44:27.

I need help in recovering a deleted youtube video by the name of SHUT UP made by arcade assassin in 2023 in which he criticized sunnyv2 for saying bad stuff about chris tyson. I cant figure out how to do this using the wayback machine.

The original post: /r/datahoarder by /u/sbourwest on 2024-07-29 09:12:19.

I've been downloading images & video for decades now, and while my internet speed is faster than ever, downloading has never been more cumbersome and annoying. Every website seems to try to find a way to prevent users from saving the content they want.

I've used just about every trick in the book to circumvent this:

• Diving into source code for direct video URLs (not very feasible anymore)
• Using Firefox extensions to prevent shell menu changes
• Using Firefox extensions to download videos (predominantly Video DownloadHelper) and images (Download All Images)
• Using third-party web crawlers to rip from specific websites
• Using web-based apps to grab a video from a URL

Yet the war against downloading continues by these websites. For every work-around or how-to guide, they tend to become invalid within a year due to some change on the back-end of the website.

Youtube, Facebook, Instagram, and pretty much any video streaming platform that attempts to generate revenue likes to f$&% with their back-end to make downloading harder and harder. There's no universal methods anymore, it feels like every website needs it's own special method to acquire content from. There's too many steps involved in what should be as simple as Right Click -> Download, it often involves either copying a URL into a web app, or ripping all the media files from a page, only to have to sort out all the crap you didn't want when you ripped it (really bad for trying to download albums).

Since these websites are leveling up their tactics, I think maybe it's best for data hoarders to level up as well. While not all of us are programmers capable or willing to create new methods of ripping, finding ways of identifying how websites manage to block you from downloading would be useful I think, if for nothing else to best identify the tools needed to get the job done. So as the title says, what are the typical and atypical ways that websites can use to prevent you from attempting to download their media, and what ways are there to circumvent it?

The original post: /r/datahoarder by /u/gvele331 on 2024-07-29 08:47:46.

Hallo!

Over the passt few years I bought a few 10tb external HDD because I only had a laptop. Now that I have a full desktop setup I wanted to implement them in my build. My case can handle 2 3.5inch drives and I'm saving up for 2 20tb drives so I would prefer keeping them outside of my case. The power cables take up a lot of space so my question is if there is any electricaly safe option to power them from my monitor?

HDD: WDBWLG0100HBK-EESN (12V 1.5A) Monitor: Corsair XENEON 27QHD240 OLED

Thank you for your suggestions.

The original post: /r/datahoarder by /u/Sptzz on 2024-07-29 08:14:46.

Hi all,

Simple question really. I have at least over a 1000 photos on albums. I've been eyeing the Epson FF 680W.

That looks like one of the more popular solutions, but just wanted to ask if anyone else has any other recommendations? The main con IMO of the Epson is the price really.

Thanks!

The original post: /r/datahoarder by /u/Tamaaaaa on 2024-07-29 07:32:58.

I wanted to refund the new harddisk i got since i found a 29 pending sector count and countless badblocks (by hddscan test) last night. I am formatting my new HDD at the time im writing this, but decided to open hdd sentinel and found this? how is this possible?

After formatting is done im going to run a hddsentinel's short self-test and one of hddscan test.

https://preview.redd.it/j6mk9v28tefd1.png?width=811&format=png&auto=webp&s=40bb2b8fe85b6baccc7411c846d548ad83df091d

https://preview.redd.it/92cuu2latefd1.png?width=824&format=png&auto=webp&s=a86424d5d63896973c0ef26d23ad898cc2c2930b

Im just going to use this disk for entertainment (plex) only, so i wont be saving any critical data, is it generally ok to keep using this disk from ur experience?

Edit: Thank you for the all the comments, really appreciate it. I'm going to return it.

The original post: /r/datahoarder by /u/fttklr on 2024-07-29 07:04:33.

I would like to freeze in time my computer room, running a local server with a couple of 10 TB drives holding movies, music and other stuff from the 90s. So all the computers connected in that room basically are "period appropriate" in terms of the media they get access to.

Although I want to go a step beyond and have also a snapshot of internet so it can be used offline. I found some mention of people doing that for Wikipedia, so it can be browsed offline, but I wanted to do something like the wayback machine instead... So have basically internet as snapshot at a specific date, as it was in 1998 for example.

From my research, the big jump in websites happened around the 2000; when we went from few million websites to about 13M. That was basically when the web just exploded in a way that made the curve a steep one, so if I stay beyond the year 2000 maybe I can still fit the entire internet as it was on a decent amount of space for offline browsing?

Is this even feasible or should I reduce the range further? Or is something like this not even possible? I am just envisioning to have altavista, yahoo and all the old websites up and running locally offline; with their news, articles and stuff as they were at a certain point in time. I am sure that crawling the waybackmachine is not a thing that make sense, so I was wondering if anyone attempted something like this and if so, how you would go by.

The original post: /r/datahoarder by /u/EisForElbowsmash on 2024-07-29 06:33:39.

I have been working on the process of transferring large amounts of my hoarded data to M-Discs, yes I know this is a somewhat slow and expensive process, but it seems the ideal solution for minimum maintenance long term "cold" storage. However, I have run into a bit of a snag.

I store the discs in jewel cases and when hundreds of them get involved, I am looking for a better and more durable way of containing and transporting them than the (now duct tape reinforced) cardboard boxes the jewel cases come in. Searching for containers for jewel cases seems to yield only 25-50 unit containers, which tend to be very expensive and not very durable. Not to mention that sometimes a single section of data I want to store together requires more than 25-50 discs.

Does anyone have any recommendations for cases/boxes that can hold 100-200 jewel cases (not the slim ones), preferably made of a hard material with handles. Preferably cost effective but a higher price for a sturdy product is fine. Thanks in advance.

The original post: /r/datahoarder by /u/umataro on 2024-07-29 06:29:37.

HELP! Wife accidentally wiped photos and videos 1 day after return from holiday and now is mad at ME! Mad at me because I let her panic for a bit before revealing our 15 minute zfs snapshots and hourly sync to backup NAS. And nightly sync to backup disk at work and nightly rsync to an exfat disk (so it's readable everywhere in case something happens to me). Serves her right for never reading the "in case I die" handbook I've been telling her about for a year.

Edit: added "accidentally" to clarify

The original post: /r/datahoarder by /u/vinaypundith on 2024-07-29 05:51:25.

Not sure if this is the right place to post, if it isn't please direct me to where. I've got a Seagate Barracuda Compute (ST4000DM004) 4TB 3.5" disk that's otherwise pretty new but stopped working after falling on wood floor from ~3.5ft high (I had it in a dock, which got yanked off the desk by its power cord). I've given up on getting any of the data from it, but if I could I'd like to get the drive working again to use for menial tasks (game disk, update cache for my server, or something else non critical). The read head keeps moving back and forth and making an unhappy clicking noise. Anyone know how I can fix this? Replace something? Thanks!

https://reddit.com/link/1ees1wv/video/32uqj7mocefd1/player

The original post: /r/datahoarder by /u/Woah_Dude04 on 2024-07-28 20:31:22.

I wanna upload when harry met sally (the movie) to twitter because its funny. I have the MP4 which is 9.02 GB and I'm willing to lose some quality to get it down to below 8 gb so I can upload it using twitter blue. I'm trying to use VLC to lower the bitrate but its a torrent so I'm not totally sure what the bit rate is right now. I think its 13.5 mbps. Does anyone have a quick and dirty way to get it down to below 8 gb? Thanks in advance.

The original post: /r/datahoarder by /u/goretsky on 2024-07-29 04:23:50.

Hello,

So, I was in the process of updating my Windows installation USB flash drive, selected the RAID array by accident, and wiped it.

Nearly 30 years of personal files gone in a few seconds, including:

• my music collection, a lot of which is of CDs that are no longer available
• videos and pictures of friends and family
• all my personal documents, including email
• software collected over the years, including source code and stuff from pre-web companies that may not exist anywhere else
• my ebook library of technical publications, fiction, non-fiction, etc.

All inaccessible in a matter of seconds.

I have four separate (and completely current) ons-site backups so no data was lost at all, though. I also have off-site and off-region backups, but some of those are older.

Anyone can make a mistake or suffer an accident at any time. No matter how good your procedures are, no matter how much preventative maintenance you do swapping mediums, there's always the human factor to consider.

One of the most important things about backups is to ensure that they can be restored. I typically perform a sync of my backed-up data 2-3 times week to other computers and then spot-check it by verifying some of the new files open correctly.

At this point in time, I'm about 90 minutes out from having all of my personal data files restored. The program file collection will run overnight, though, and I'll check on that in the morning.

Learn from my mistake, and make backups.

And make backups of those backups.

And make backups of those backups of your backups.

And make backups of those backups of those backups of your backups.

The point is, you can never have too many backups.

This is the first time in many years I have had a major data loss incident like this, and while I am mildly frustrated and embarrassed, I also realize there is a teachable moment here to learn from, and maybe someone will find this helpful.

Regards,

Aryeh Goretsky

The original post: /r/datahoarder by /u/Fuyu_dstrx on 2024-07-29 03:09:52.

tl;dr: after some Raid 5 Software recs that can scale later

I'll try keep this short and succinct.

I'm a Hobbyist photographer/videographer running out of space and soon losing access to college onedrive.

• Speed is not of major concern, mainly archiving old footage/projects
• 1 layer of redundancy is enough. If 2 drives die at the same time, I'll cope.
• Currently have about 2TB space locally on desktop, no backups.
• Ideally after an additional 2-3TB now, but scalable down the line

Hardware RAID through NAS/DAS seems like high initial investment for something as basic as an extra 2TB.

Windows Storage spaces seems like it would work but I hear some bad experiences.

Edit: Currently considering 2 sets of 2x 2TB Seagate barracudas, 2 seperate RAID 1 setups through windows storage spaces.

Or if there are other options to consider for my situation, please do let me know.

Thanks in advance.

The original post: /r/datahoarder by /u/monkiesandtool on 2024-07-28 23:45:21.

The original post: /r/datahoarder by /u/nutrigrain on 2024-07-28 23:43:50.

I'm planning to use QNAP TS-870 Pro (inherited). I believe it only supports RAID5/6. Currently, it has 3 x 4TB drives.

Is it possible for me to stick in new drives or remove/replace old drives without much effort? Planned future scenarios:

• Put in new 12TB or greater drives, does it automatically rebuild the raid and balance everything out?
• Remove old 4TB drives after adding new 12TB drives. Again does it automatically rebuild?

Since the unit is relatively old, if the PSU dies, what are my options? can I recover the data somehow? (e.g., stick it in a non-qnap linux pc and recover?)

The original post: /r/datahoarder by /u/arcticwanderlust on 2024-07-28 22:58:21.

Dear Community and KDE,

I just installed this Global Theme, innocently (Global Themes -> Add New...):

https://preview.redd.it/q66u1i48bdpc1.png?width=367&format=png&auto=webp&s=91e5dafcff6308ee63825996d7bc3b6e1f23535f

It DELETES all your USER mounted drives data. It executes rm -rf on your behalf, deletes all personal data immediately. No questions asked.

I'd appreciate it if anyone could escalate this, I find it totally mind blowing that installing skins allow script execution so easily. I cancelled this when it asked for my root password, but it was too late for my personal data. All drives mounted under my user were gone, down to 0 bytes, games, configurations, browser data, home folder, all gone.

As per OpenSUSE Reddit users, they indicated that this plasmoid executes rm functions (see https://www.reddit.com/r/openSUSE/comments/1biunsl/hacked\_installed\_a\_global\_theme\_it\_erased\_all\_my/)

Please investigate and escalate :) - I'll be busy reinstalling all my system from scratch, restoring data to go back to work.

UPDATE: Really wanted to appreciate the community for the response and overall reactions of developers. Remember to backup important data, and keep in mind we are all part of making these systems better, as I felt well to be able to share this and be heard. In any OS us users authorize programs to execute things on our behalf, so remember always to run trusted software! I can't confirm whether this was malicious, to my understanding it was just a compatibility and programmers mistake gone south. Looking forward to what this brings in unmoderated community content management.

The original post: /r/datahoarder by /u/bmayer0122 on 2024-07-28 22:25:56.

The original post: /r/datahoarder by /u/nlj1978 on 2024-07-28 21:01:46.

Lost the computer that held my data due to a power surge through the cable. Looking to replace the computer while keeping my fingers crossed that my data survived.

Pc was a HP Z1 g5 workstation that had plenty of room for my drives. Currently 2- 3.5" and 1- 2.5", in addition to a NVME boot drive.

Struggling to find a good deal (tight budget as ive had to replace a lot of equipment from the surge)on a similar system with large case. I am seeing lots of good deals on mini and micro form factor systems that would meet my needs.

Started looking at usb 3.1/3.0 drive enclosures but have some questions.

Can I still map each drive individually in a USB type enclosure or do I have to utilize some form of raid?

Current setup was a 3.5" drive was primary Jellyfin media, the second was a redundant copy of the first. The 2.5" was used as a shared drive on my network and for backup of a couple of computers.

The original post: /r/datahoarder by /u/ForeignLemon5 on 2024-07-28 20:39:53.

The original post: /r/datahoarder by /u/YesThisIsi on 2024-07-28 19:31:14.

So i have been moving from icloud to local backups.

My issues is these

• Apperarently NextCloud AIO VM only supports internet-backups and i want to do local ones. You can do this(?) but it's probably pain in the ass.
• Resilio Sync doesnt support Windows server unless you give out cash
• Syncthing doesnt apperanetly have native iOS app?

I want to do the backups locally cause i use Ubiquiti Teleport "on-the-go" to access my LAN. Whats the easiest and best way to achieve this?

The original post: /r/datahoarder by /u/NatSpaghettiAgency on 2024-07-28 19:01:14.

I'd really love a nice Excel template you use, if any :)

The original post: /r/datahoarder by /u/justarussian22 on 2024-07-28 18:12:42.

Hey all. Ive decided i want a 4 bay synology nas. I dont understand if or why id need a raid setup. Lets say i have 2 10tb drives for a total of 20tb in 2 drive bays. Would raid require me to use the last 2 bays resulting in me being unable to add capacity later on? What makes sense for me?