It's A Digital Disease!

The original post: /r/datahoarder by /u/Asleep-Structure-512 on 2024-09-04 00:26:56.

Hello All,

I seem to have copies of copies of my files on ZFS Truenas server. What is the best way to remove copies of copies of data. I have a mix of family photos and MCAM tool paths.

I was trying to use CloneSpy but that was taking hours to run over GBE lan. I will get the hosts connected over 10G for the real de dupe.

NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT

bigdata 43.5T 30.4T 13.1T - - 0% 69% 1.00x ONLINE /mnt

What is the best way to A find dupes and B remove dupes?

Thank you kindly!

The original post: /r/datahoarder by /u/BrightEyes1616 on 2024-09-03 23:09:34.

I'm pretty new, not tech savvy and have only been researching this for the past few days. I'm looking to get some S3 cloud storage (perhaps Backblaze B2 but maybe one of the others that I've seen recommended around here) as my data grows. I need a tool to backup my PC with a one way transfer and also sync certain folders on the S3 cloud storage between two computers and an android phone in a bidirectional manner, e.g. something like what Onedrive or Dropbox does. The tool should probably be able to encrypt files too. Looking for a low price, high simplicity and low knowledge needed. S3Drive looks promising to me, anyone tried it? I've also looked at Syncovery and Mountain Duck, and both seem good but I don't yet have the knowhow to work out what the difference between these 3 is, if they suit my simple purposes, or if there is a better or cheaper alternative that doesn't require too much learning or has a difficult UI. I lean towards S3Drive as the website just seems clean and makes the most sense to me. And at €50 for life it's cheaper than Syncovery. I've read less about Mountain Duck and am therefore not sure about it but it seems to do the things I want. I'm ideally looking a simple solution that can do it all. Other suggestions are also welcome, please let me know why (e.g. the ones I listed aren't fit for my purpose or are more expensive, complex, etc). Thanks to anyone who helps!

The original post: /r/datahoarder by /u/DrWho345 on 2024-09-04 11:35:28.

I’m using an old iMac, I don’t have anything else.

Trying to make a backup of my entire images folder, over 1.3mil images, 500+GB, in case anything happens, and the only free drive I have at the moment is a DS411J, with 4TB free. Ever since apple no longer reads images inside sub folders, I could only get my background to shuffle and show random images, if they were all in one central location.

Programs/apps I have attempted so far Carbon Copy Cloner Times out

TeraCopy Keeps closing

Hazel Want to copy not move

FileZilla Error messages

Synology itself Times out

Automator Gets close but won’t let me select a million images at once

Command One Too long to start

Only thing that seems to be working is SyncTime I can start/stop at my choice, but it still says months to finish.

Although I do backup to Time Machine daily, so I guess I technically already have a backup, right?

Any alternatives would be greatly appreciated, I must be doing something wrong.

The original post: /r/datahoarder by /u/TheShaggyDoo on 2024-09-04 11:05:34.

https://a.co/d/81qxTDc

Hi! Was looking for a simple external hdd for my pc. Something decently fast, with a nice life expectante.

Was using an 8 year old 1tb internal laptop hdd with and adapter and it has not died on me yet. But 1tb is no longer enough.

I used it as one of my many phone backups, alongside movies, ebooks, games (around 120gb), ecomics, a great amount of game clips (around 700Gb now xd), some safeplace for music, etc.

Is this good? It has a lot of positivo reviews, but i always doubt of the 5 star reviews cause it tends to be a bunch of people with not much knowledge, but way too happy with a decent product .

The original post: /r/datahoarder by /u/oShievy on 2024-09-04 07:36:28.

I'm planning a NAS build and need some input on component compatibility. Here's what I have and what I'm planning to get:

**Current Components:**

• CPU: Ryzen 5 3600 w/ stock cooler
• RAM: 32GB DDR4
• GPU: GTX 1050ti (full height) or RTX 3050 (low profile)
• Storage: 2TB NVMe drive

**Planned Additions:**

• Motherboard: ASRock B550M-ITX
• Storage: 4 x 8TB refurbished HDDs
• Case: Node 304

**Main Question:**

Will the Node 304 case accommodate the 4 HDDs along with either of my GPUs? I know the case supports ATX PSUs, but I'm concerned about space with the full-height 1050ti.

The original post: /r/datahoarder by /u/Auspede07 on 2024-09-04 07:26:10.

Hello, I have a some questions regarding the Seagate Exos X18 for regular PC use and would like to hear peoples experiences with it.

For reference, I have 8TB Barracuda Hard Drives and I'm used to their noise levels.

What are the noise levels for Exos X18 like?

Is it only noisy when it's writing data?

How does it sound while playing a movie compared to a Barracuda Hard Drive??

What's the Exos X18 noise like while torrenting?

What are the customizable power options about? What would be recommended setting for a PC user?

And lastly, if the PC is only on for a couple of hours a day and the hard drive is barely used, will this adversely affect the lifespan of the hard drive?

Thanks in advance for anyone that takes the time to answer

The original post: /r/datahoarder by /u/grathontolarsdatarod on 2024-09-04 06:23:43.

Running vanilla Debian.

Got a mdad raid 5 with 4 disks. All the disks are the same.

Running in a sabrent 5 bay, one bay is empty.

Moved the 4-disk raid into a 4 bay sabrent to test and visa versa.

Consistently, when I cannect this raid to any machine, it constantly accesses the raid at about 2mb/s.

Its only been Debian I've connected to, but both plasma and gnome. This particular set of disks will just do that.

Snooped around for processes doing it, and finally found a that the accessor is always associated with plasma or gnome desktop processes.

Mdadm shows no anomalies. Or tasks, or processes running.

Finally took the step of nuking the raid and rebuilding from scratch cause I thought made it was built properly to begin with and there was a sneaky scrub going on in the back. Nope. Does it again.

Any suggestions? Bad disk, or a disk going bad? I've isolated as much as I can here I think.

The original post: /r/datahoarder by /u/Foooxhound on 2024-09-04 06:00:42.

Hey Hoarders, I need your help … Yes I’m am one of those messy kind of guys that has folders in folders where you can find - you expected it - folders.

Mostly it aren’t high important files, but images and videos - hundreds of thousands of them. Often there are like 12 duplicates of a image. That’s because I once in a while download my complete iCloud Photos, save them, forget what I already downloaded a few months later, download them again and so on.

I have like 6 external drives where you will find some duplicates too. So maybe on external 1,2,3,4 you also have one image like 5 times.

I know, it’s my own fault but I want to get my duplicates life back to normalization.

Additional do you have an idea for a really good folder structure? So I could keep my external hdd 1 for e.g. 2022/2023 and external hdd 2 for 2021/2020?

TLTR: I have an Chaos of images with duplicates I want to get rid but it think it’s out of hand at this point. Do you know any method / software or other helpers to bring harmony into my chaos? It’s content of my children from the last 9 years for example, but sometimes even older.

Thank you in advance

The original post: /r/datahoarder by /u/Setsuna_Kyoura on 2024-09-04 05:25:14.

I've tried so many backup programs (paid+free) and every single one sucks in a way. Either they are slow as hell, unreliable, unstable or bloated and buggy.

I only want a simple program to make some backups to my USB-Diskarray, that just works! The only thing that never let me down is just plain copying all files with Teracopy. But incremental backups and file compression would be nice...

The original post: /r/datahoarder by /u/jaytrouts on 2024-09-04 05:11:07.

Been looking for quite some time now and haven't found one. I'm eyeing your prices and they look amazing compared to my Nordic country, but the 120usd shipping puts me off

The original post: /r/datahoarder by /u/No_Independence8747 on 2024-09-04 05:04:46.

Got a 12tb had in a usb 3.0 enclosure. I connect it to usb 2.0 devices but I’m estimating 50mb per second write speeds on older macOS machines. It estimated like 18 hours to write about 300gb of data from my computer. What gives?

Edit: they’re usb 3.0 not 2.0. I wanted to err on the side of caution

The original post: /r/datahoarder by /u/SeparateFly on 2024-09-04 03:38:24.

I am looking for an NVMe SSD that I can use with an external enclosure and treat it as a slightly larger USB thumb drive. I see this one:

https://www.westerndigital.com/products/internal-drives/wd-blue-sn580-nvme-ssd?sku=WDS100T3B0E

has 4150MB/s seq read performance but am wondering if it will be throttled given an external enclosure. Does anyone have ideas what I should look for? Thanks.

The original post: /r/datahoarder by /u/mttscz on 2024-09-04 01:54:03.

Hey, DataHoarders! I've been using WFDownloader for a while now and I really like its results.

My problem is that whenever the name of a folder containing files is changed, the program doesn't update the new information. As a result, it ends up downloading everything again in the next batch update.

How do I change the name and location of a folder within the app so that it keeps updating the batches? I want to avoid having to download everything again every time a piece of information is changed.

I imagine it's a very beginner's question, but I couldn't find anything about it anywhere.

Thank you very much.

The original post: /r/datahoarder by /u/Over-Coat-5511 on 2024-09-04 00:57:24.

I'm completely new to this hobby so please bear with me. I want to rip my movie collection and play it on a Zidoo media player. I live in a rural area and I'm limited to 1tb of data a month on my internet before they throttle my connection. I'd like to connect directly to the Zidoo z9x 8k via the usb 3.0. Should I just use a DAS or can I connect a NAS directly to the player. Also should I go with HDD or SSD? We will be ripping a lot of 4k movies for the home theater and they would use a lot of data streaming uncompressed. Whatever ideas y'all have would be greatly appreciated!

The original post: /r/datahoarder by /u/SgtKrowyn on 2024-09-04 00:53:27.

Hello all, I’m new to this space and I am hoping to get some help/clarification. I have a new project I’m working on which is to build my own “cloud” to back up photos and other files for my family so we can stop paying for cloud storage. I got that up and running using Nextcloud but what I want to do now is build redundancy as I am using used hard drives.

I saw windows has storage spaces which appears to offer a windows flavour of raid 5, so I got 2 more drives (3 total) but I noticed it would not let me use the one drive I have running windows to add it to my combined drive.

I am hoping anyone have any solutions other than to buy a 4th drive, run storage spaces with the 3 empty drives and then clone my files to the combined drive before adding my first drive to the combined drive.

The original post: /r/datahoarder by /u/anionaman on 2024-09-04 00:30:09.

Greetings,

I recently purchased an 8 bay enclosure SY-ENC50119. It's USB3 w/ external power. I'm running windows 10 w/ a 9700k, gigabyte z390 aorus pro.

I'm having trouble configuring the enclosure to not turn off as soon as the computer goes into an idle state. I'd like for it to stay running. I tried using their firmware updater and setting idle limit to none but it makes no difference. Setting a limit also didn't help. I tried disabling "allow the computer to turn off this device to save power" in device manager but that didn't help. I'm not really sure what else to try. I've tried Syba's support and maybe they'll get back to me but haven't heard back yet after 3 days. Any suggestions would be greatly appreciated.

The original post: /r/datahoarder by /u/karl_azytzeen on 2024-09-03 23:46:00.

This is a project that i should leaved in a drawer for a long time. Its time to move on. Now i need to get up to date, but Will like to take profit on what i have stored. Supermicro X11SSH-CTF, Xeon 1270V6, 6xWD80EARS. I hace also a super micro tower with frontal bays. Looking for a decent DDR4 ECC udimm, but seems hard to find first brands in EU, probably looking for new old stock. Im open for any sugestión and tips. Have nice datahoarding!!

The original post: /r/datahoarder by /u/Vagaborg on 2024-09-03 21:28:42.

So lesson learned.

sudo rm -r someshow.s1e0*

will remove episodes1-9.

sudo rm -r someshows1.e0 *

will remove everything in that directory.

The original post: /r/datahoarder by /u/After-Leopard on 2024-09-03 21:24:04.

I have some mini VHS tapes, 2 different sizes of course, and I need to finally make them digital. The camera no longer works so I have no way to play them. I am not a techie and have limited equipment so I’m not looking to do it myself. I only have 5 tapes total so it’s not really worth buying a lot of stuff anyways. So what company is supposed to do a great job and also be safe to send these to?

The original post: /r/datahoarder by /u/Yermo45 on 2024-09-03 21:21:21.

The original post: /r/datahoarder by /u/TyrantGnome on 2024-09-03 20:57:21.

so I'm looking to setup a 5 bay storage rack, I'm not sure on if I want a nas or a raid setup but I was thinking of having 2 silicon power ssds and 3 (not sure yet) hhds. I have no idea on if the silicon power ssds support this and I'm not sure on what sort of bay setup I should get. was thinking a small tabletop one that could allow hotswapping/plug n play so I can take one on travels with me. if anyone can suggest decent priced hhds and a rack that is good id be very appreciated. (mostly looking on amazon uk but can look on other sites)

The original post: /r/datahoarder by /u/rat_blaster on 2024-09-03 19:45:29.

hey there - been looking but can't find an answer to this. i've tried a couple different extensions, but nothing seems to work for private tweets, and trying to yank them directly from the network tab doesn't work either. any help would be appreciated. thanks!

The original post: /r/datahoarder by /u/pandatransg on 2024-09-03 19:15:55.

So over the weekend, I picked up a couple 12 TB (HGST Ultrastar DC HC520) hard drives which I came across on Slickdeals (Link here) as it'll be my first storage purchase. I've done some research and I think I would want one of the drives being my main HDD while the other will backup the first drive. (If that makes sense)

I will mainly be using it to store / watch anime from and graphic design work (illustrator files, etc) so it will be sitting on my desk behind/underneath one of my monitors.

General Notes/Questions:

• Do I need to get an enclosure with a fan built in?
• Here are some options I came across on AliExpress:
  • Orico 2-bay HDD
  • MAIWO 2-bay HDD
  • Acasis 2-bay HDD

I've also seen some Sabrent ones on Amazon too, but I'm not sure whether I like having the hard drives sticking out open but if it's better, I'm willing to deal with it.

I'm really new to this and I'm looking for a dual bay HDD enclosure that helps me do my basic needs. Any help would be appreciated. Thanks!

The original post: /r/datahoarder by /u/DoctorQuinlan on 2024-09-03 17:49:39.

My photography content is about 1.5 TB and my MBP is 500 gb.

I recently found out that you can backup Macs + external drives to Time Machine, but this seems unhelpful if my photography drive is 1.5 TB and my TM backup drives are around 2-4TB.

What would be the best way to go about this? I also have iCloud, but can't think of a decent way to get my photography stuff there without mixing my personal and photography libraries, which I do not want to do. .

.

For Mac, I am thinking:

1. TM backups to 2 external HDDs
2. Photos and important documents to iCloud also (which is basically the only things of importance on my Mac - I think pretty much everything is backed up to iCloud, which I share with family but have about 1.5 TB of space left). .

.

.

For Photography, I am thinking:

1. Manual backup from camera to SSD (this will be what I edit on and categorize stuff on - right now this lives in the Apple Photos app, but I may move to folders)
2. Manual backup from camera to another HDD (this is what I dont really like because it is manual and edits will differ from the other SSD).
3. Maybe add Backblaze...? For this and Mac since both would be included.

.

.

Any tips on how to streamline this more? Ideally would be as automated as possible. The weak point is definitely my photography stuff but due to the large volume size (which I am trying to cut down by deleting photos), it's very difficult to find a better alternative!

Please help! Thanks!

The original post: /r/datahoarder by /u/Honza572 on 2024-09-03 17:30:20.

I"d like to ask you guys if you know any good way to solve them. I accept Linux/Windows solution, I don"t really mind trying out some new distro.

So my first issue is, that I have no way to easily add tags and then search files with them. I don"t want something like #tag in the name, the searching is unnecessary long that way, I also have a lot of small files/videos. I"d love to get my hands on some paging program that"ll simply remember where my shit is and rescan my pc after each launch for newest files. I prefer simple .txt files in case I need to move my files elsewhere, also idc how old is that program I have some great ones from year 2000

My second issue is also related to paging, and it"s with file size, creation/modification dates and so on. WHY THE F CN"T WINDOWS SIMPLY REMEMBER IT? I don"t understand please give me some solution, preferabely free one.

Also sorry for the " instead of single one, I need to remap my number keys so they work with alt+code (and the +ěščřž... too) and I way too lazy to do it yet.