It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
4776
 
 
The original post: /r/datahoarder by /u/jamestossed on 2025-01-06 10:50:49.

What is currently the fastest scan tool to find delete/recovers files that were moved from a disk.

I used R-Studio, but it took almost 24h to scan a 10tb disk. Is there anything faster?

I was restructuring my data drives copying data around new drives, when a disk head died.

4777
 
 
The original post: /r/datahoarder by /u/buddy-bubble on 2025-01-06 10:10:50.

I am using several USB 3 HDD currently as data storage, mainly for media that I play via Nvidia Shield / Kodi. I directly connect the external HDD to the shield to watch something or connect it to my PC to copy over new media. Now that I am running out of storage space on the external drive, I am thinking should I just buy another external HDD?

Pro: Cheap and easy

Con: Not sexy, have to remember which drive is which, does not scale

Or should I build my own NAS ?

Pro: Stuff to tinker with (i like that), scales way beyond what ill ever need, no more running around with external drives in my home

Con: more expensive, slower (?), constant power draw

Would like your opinion, what would you do? Also, how fast is transfer speed via NAS realistically going to be? It would be connected to the Nvidia Shield via Gigabit Ethernet.

4778
 
 
The original post: /r/datahoarder by /u/sojta27 on 2025-01-06 09:35:10.

I initiated a Data transfer of 3.53TB earlier tonight after almost completely filling up a 4TB hard drive. However after initiating the transfer I can't login to my digital desktop on the computer app, website, or phone app.

4779
 
 
The original post: /r/datahoarder by /u/user_393 on 2025-01-06 09:15:37.

According to IEEE, we are heading towards 40 TB (this year) and 60 TB (in 2028) drives, and going from $13 to $6 to $3 per TB of storage in those years. Achievable?

https://i.redd.it/8016m60accbe1.gif

4780
 
 
The original post: /r/datahoarder by /u/Neathh on 2025-01-06 02:18:42.
4781
 
 
The original post: /r/datahoarder by /u/wehavelemeats on 2025-01-06 01:40:48.

I have around a thousand bookmarked videos from TikTok that I would like to save. What is a user-friendly tool that I can use to mass download? Thank you in advance for any help!

4782
 
 
The original post: /r/datahoarder by /u/Onyxx666 on 2025-01-06 08:07:49.

So I was big into Counter-Strike: Source back in the day and wanted to see some of the old addons I used to play with from the Eventscripts website and its no longer there. I see there are a bunch of waybackmachine archives but I'm having trouble trying to back up the whole website with all 4k+ addons.

I can currently click on the links and pages and it takes me there in the archive I can even get downloads from the main site and it directs me to their download sever but I'm having trouble getting the website as a whole. I have tried a couple of ways but I can only get like 10 pages or so.

Does anyone have a working solution to grab the entire website?

4783
 
 
The original post: /r/datahoarder by /u/Vast-Program7060 on 2025-01-06 07:49:18.

I e-mailed some well known hosters about getting a dedicated server around x-mas time. One of them told me they had a customer request 1,000 drives for an upcoming quote they were putting together, and apparently the hoster ordered them before the design was complete so that they would have them on hand, and then the customer would pull the trigger and order the new setup, but the buyer backed out. So they said they have all these newly setup servers, 1u's, 2u's,3u's, and 4u's all ready for drives so this project would be setup quick. So they said they could quote me an attractive offer because they had excess stock of everything, I just told them, I don't need anything super powerful, I just need a server capable of storing files, and need 120TB of space. We went back and forth, but they said they would set me up with a single xeon server, 32gb ram, 10x 12TB drives, and 1gig unmetered/unlimited bandwidth. We haggled over price, but i got them down to $130.00/month.

Now, the GOOD stuff. I waited forever for it to get built, but in the end I think they intended this build for someone else, but they have not said anything to me, and I have spoken to them since I got it and they didn't notice anything. What i got delivered, was better the x-mas. They gave me a bare metal ( can go into bios, update settings ), server that has dual xeon e5 v4's, 256gb ddr4 ecc ram, 1x480gb ssd, 4x 1TB nvme SSD's, 10x 12TB hgst drives, dual quad port 1gig cards, 2x connectX-4 lx cards. Speed tests to local server get me 4gb up and down in Linux ( was suppose to be limited to 1gig ).

I can't believe I'm paying $130/mo for this. It is way overpowered for just a file server for personal use....lol

I'm not sure what else to do with it. Run proxmox, so I can utilize this servers power? Then running multiple vm's? Like TrueNas, Windows, Linux, or whatever. It just feels like a waste just to run a single instance of Linux on it to transfer files to and from. Utilization never goes above 2% lol.

4784
 
 
The original post: /r/datahoarder by /u/Euresko on 2025-01-06 04:45:46.

Is this new, refurbished, or what? Seems like a good deal. Says out of stock, I think, but I can add to cart.

Seagate Exos X16 ST16000NM001G 16TB 7200RPM 512e/4Kn SATA 6Gb/s 256MB Cache 3.5-Inch Enterprise Hard Drive (OEM) - 5 Year Warranty

https://www.goharddrive.com/Seagate-Exos-X16-ST16000NM001G-16TB-3-5-HDD-p/g01-1817.htm

4785
 
 
The original post: /r/datahoarder by /u/chrpai on 2025-01-06 02:00:15.

I just picked up 4 20TB Seagate Expansion drives from BB for $230 a piece. ($11.50/tb). Shucking revealed they are HAMR drives branded as Baracudas.

https://preview.redd.it/hyjnqy7e6abe1.jpg?width=480&format=pjpg&auto=webp&s=cea1b2c47c0f2a75250db92f42119aefb07eff7b

4786
 
 
The original post: /r/datahoarder by /u/Suchamoneypit on 2025-01-06 01:16:01.

I'm currently using a CS380 with x11 6TB HDDs (3.5"), 2 being parity. This is a media server, NAS, etc. My primary goal is to switch to a rackmount case. Ideally, I really don't want a massive 25" deep case. a secondary goal is I really want 100TB of usable storage, whilst retaining dual parity drives. My future plan is switching to 12TB HDDs to achieve this. At the bare minimum, I need 10 drives. Ideally, 11 or more. I need support for a micro ATX board to support an HBA card and a low profile GPU for transcoding. Support for standard size PSUs is a plus. One consideration is switching to a CPU with an iGPU for transcoding, and using mini-ITX with its single slot for the HBA card to open more case options. I also heavily prefer sticking to ATX form factor over proprietary setups.

Current best options I'm seeing are:

Sliger CX3702 - only 10 HDDs, but prefect size. Expensive. 3U. only 100TB usable with single parity.

Rosewill RSV-L4500U - Massive, heavy, 4U. Excellent HDD support (15). Very affordable. Great cooling.

One big question I have; is there a product which is essentially JUST the HDD drive portion of the Sliger CX3702 that would be connected to via an HBA card and a long cable? Having something like a CX3072 with a second bay of drives below it for a 20 drive capacity would be incredible and affordable. I don't want my media server split into 2 separate servers. I'm having a hard time finding a product like this but I'm new to rackmount and pretty sure I just aren't searching the right terms. I couldn't even find Sliger in normal google results but only even discovered the company through reddit comments.

4787
 
 
The original post: /r/datahoarder by /u/Finley_Brown on 2025-01-06 01:11:33.

Is ti doable for HDDs ? People are doing it for all sorts of stuff with great effect.

Why not for either new or factory refurbished HDDs ?

Datacenters get new models for prices FAR below listed prices. And places like serverpartdeals obviously operate with hefty margins, so there sems to be plenty of room.

Is there an option to aggregate the order and join it with some smaller datacenter or something ?

4788
 
 
The original post: /r/datahoarder by /u/Character_Age_4357 on 2025-01-06 00:30:13.

This is my first reddit post, but I’m desperate and google isn’t helping me

I have a phone with 16 GB of photos and roughly 120GB of videos of my daughter on it… and I have never backed up my phone.

My father in law told me about Amazon prime having storage backup, but it only allows 5GB of videos. Online said google photos storage limit is 15GB. I looked Into Samsungs cloud service, and it seems like that would work, however My phone is at 55%, it no longer wirelessly charges, and the charging port is broken. Im scared that I will lose everything if I don’t chose the right back-up option from the start. My phone is a Samsung Note 10. I know this subreddit shouldn’t be used like a personal IT support technician, but I’m desperate and I don’t know of another place / subreddit that could help me.

4789
 
 
The original post: /r/datahoarder by /u/Dungeon_Crawler_Carl on 2025-01-06 00:25:16.

I recently purchased Epson ES-C220 scanner, but was wondering if there are 3rd-party scanning software I can use that is better than the Epson ScanSmart program it comes with.

I plan on eventually storing PDFs on Paperless-ngx.

4790
 
 
The original post: /r/datahoarder by /u/jdrch on 2025-01-06 00:07:39.

I have a laptop that's going back to the manufacturer for warranty repair.

NOTE: As the laptop is being repaired because it won't charge or power on, I cannot boot into it. Also, I was unable to setup proper backup on it since I only got it last week and I'm setting up a new backup server since my previous one failed

The laptop's OS M.2 SSD is Bitlocker protected. Here are the steps I'm currently doing

  1. Remove M.2 SSD from problematic laptop
  2. Place SSD in USB to M.2 adapter
  3. Connect adapter to another PC
  4. Unlock SSD using its Bitlocker key
  5. Clone the SSD to a USB stick
  6. Disconnect adapter from other PC
  7. Return SSD to problematic laptop
  8. Send laptop in
  9. Receive repaired laptop
  10. If original installation has been paved over, disable Bitlocker and reboot (doing this because I've noticed some laptops refuse to boot a new unencrypted SSD if the last SSD it booted with was encrypted)
  11. Turn off repaired laptop
  12. Remove SSD from repaird laptop
  13. Repeat Steps 2 & 3
  14. Clone USB stick back to SSD
  15. Repeat Step 6
  16. Put SSD back into repaired laptop
  17. Boot into Windows
  18. Re-Bitlocker replacement SSD

Does that make sense? Am I missing any steps?

4791
 
 
The original post: /r/datahoarder by /u/jcretrop on 2025-01-06 00:05:12.

I currently have a OWC ThunderBay 4 with Thunderbolt 2 I’ve had for years and it’s been fairly rock solid in a JBOD config using with plex and general photo/music storage. It’s connected directly to a Mac mini that we use for everyday use (not a dedicated plex server). With backblaze, the entire thing is backed up to the cloud.

When I started ripping 4k’s for plex, direct rips, I acquired a 18 TB external hard drive. It’s now almost full. Rather than getting a second stand alone external drive I’m looking at an either moving everything to an 8 bay enclosure or perhaps setting up a second 4-6 bay enclosure just for 4k rips.

I could go with another thunderbay 4. Browsing suggestions I’ve also come across the TerraMaster D6-320 and the Syba 8 bay usb-c 3.2 enclosure (https://a.co/d/dlhIN57). Would there be any appreciable difference between these?

4792
 
 
The original post: /r/datahoarder by /u/caccialdo on 2025-01-06 00:02:57.

I'm looking into building or buying my first NAS, mostly to act as storage + plex but some other tasks like a VPN or a reverse proxy are also not excluded. I'd like to start with something relatively small with 2 to 4 drives and give myself the ability to upgrade to something with more bays and more oomph in the future.

For that reason, I'd like to avoid ending up in a situation like this one. If I understand correctly, a traditional RAID array would be out the question given how diff distros / hardware manufacturers handle those. Unraid seems like it would let me move drives between machines and add drives over time so on paper that OS fits the bill. I could even add drive of diff capacity as the cost/TB goes down over time which is icing on the cake (but not a must-have imo).

Q: are there other OSes or hardware solutions that would let me achieve that?

4793
 
 
The original post: /r/datahoarder by /u/DavidWSam on 2025-01-05 19:24:20.

https://preview.redd.it/l42r0jnw68be1.png?width=661&format=png&auto=webp&s=bce00fb34179a6db8404f4614716db5e03271c83

So, bought four Intel DC S3700 SSDs from plusdrives on ebay. One of them seems to have 92000 hours with only 12 LBAs written. The other ones seemed fine with 150-800 TB written. Just got me wondering if this one is faulty or has been tampered with somehow. That temperature reading is low as well.

4794
 
 
The original post: /r/datahoarder by /u/wells68 on 2025-01-05 18:39:54.

Why are all my old drives still working?

I've had quite a few different computers between 2007 and now. With drive docks, external cases and NASes I've created numerous backups and archive drives with HDDs and more recently SSDs. This weekend I catalogued my saved 24 drives, powering up each on as I do every year or so.

They are all working and according to CrystalDiskMark are healthy with no reallocations! Back in the 2000s I remember I had a couple of dead drive that I then destroyed, but since then, as a confirmed DataHoarder, I've kept them all. The brands include WD, Seagate, Samsung, Hitachi, Crucial, Inland and a old Freecom. Power on time for my oldest is 7.3 years.

I'm a firm believer in backups. Any drive can die at any time, but I've had only one drive go corrupt in the last 18 years, and that one was fine after reformatting.

Am I just lucky? Are HDDs really as impermanent as we all think they are?

4795
 
 
The original post: /r/datahoarder by /u/NutWeevil on 2025-01-05 16:33:18.

Hi, Recently I backed up my western digital drive SN350 to a pc in local network (2.5Gbit ethernet)

the read speed were unstable between 5MB/s to 100MB/s (mostly bellow 20Mb/s)

I don't know if i can trust the drive, and i couldn't find the root cause. any help/idea will be much appreciated.

I tried to copy to local RAM drive (to check if the target is the problem) same speed. so it wasn't the target.

I tried to copy to the same target from another nvme drive, I got max bandwidth (~300MB/s) so its not the pc/background process or the copy method. I tried multiple copy method. rsync, teracopy (samba) same problem.

no errors on SMART. no errors from HD Sentinel.

I formatted the drive and I the speed are good now after short tests. i will update.

I got good result from crystal mark before and after the format. see below benchmark and smart data

the result below are after format but there were the same when i was ~90% full.


CrystalDiskMark 8.0.6 x64 (C) 2007-2024 hiyohiyo

Crystal Dew World: https://crystalmark.info/


* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]

* KB = 1000 bytes, KiB = 1024 bytes

[Read]

SEQ 1MiB (Q= 8, T= 1): 3532.399 MB/s [ 3368.8 IOPS] < 2373.14 us>

SEQ 1MiB (Q= 1, T= 1): 2358.364 MB/s [ 2249.1 IOPS] < 444.22 us>

RND 4KiB (Q= 32, T= 1): 545.340 MB/s [ 133139.6 IOPS] < 236.11 us>

RND 4KiB (Q= 1, T= 1): 51.737 MB/s [ 12631.1 IOPS] < 78.98 us>

[Write]

SEQ 1MiB (Q= 8, T= 1): 2809.794 MB/s [ 2679.6 IOPS] < 2976.34 us>

SEQ 1MiB (Q= 1, T= 1): 2451.960 MB/s [ 2338.4 IOPS] < 427.13 us>

RND 4KiB (Q= 32, T= 1): 395.391 MB/s [ 96531.0 IOPS] < 330.29 us>

RND 4KiB (Q= 1, T= 1): 196.355 MB/s [ 47938.2 IOPS] < 20.74 us>

Smart info:

(02) WD Green SN350 1TB


Model : WD Green SN350 1TB

Firmware : 33006000

Serial Number : ************

Disk Size : 1000.2 GB

Interface : NVM Express

Standard : NVM Express 1.4

Transfer Mode : PCIe 3.0 x4 | PCIe 3.0 x4

Power On Hours : 1567 hours

Power On Count : 923 count

Host Reads : 2647 GB

Host Writes : 2587 GB

Temperature : 42 C (107 F)

Health Status : Good (100 %)

Features : S.M.A.R.T., TRIM, VolatileWriteCache

Drive Letter : E:

-- S.M.A.R.T. --------------------------------------------------------------

ID RawValues(6) Attribute Name

01 000000000000 Critical Warning

02 00000000013B Composite Temperature

03 000000000064 Available Spare

04 00000000000A Available Spare Threshold

05 000000000000 Percentage Used

06 00000054BAB4 Data Units Read

07 00000052CAE8 Data Units Written

08 00000135473A Host Read Commands

09 000000FCBEF7 Host Write Commands

0A 00000000029E Controller Busy Time

0B 00000000039B Power Cycles

0C 00000000061F Power On Hours

0D 000000000015 Unsafe Shutdowns

0E 000000000000 Media and Data Integrity Errors

0F 000000000010 Number of Error Information Log Entries

4796
 
 
The original post: /r/datahoarder by /u/Firestarter321 on 2025-01-05 15:31:36.

This is actually for work, however, I’m wondering what people’s thoughts are.

It’s just for a NAS that hosts backups with no databases or VM’s. The only like data is for a bookkeeping file storage system that isn’t I/O intensive.

We have 14TB MG07, EXOS X14, and HC530 drives to use for the project.

The machine has an E5-1680 V4 CPU and 128GB of RAM with an SFP+ card installed and is running TrueNAS Scale.

There will be a twin machine offsite to back up the main machine to using ZFS replication.

I‘ve used mirrors everywhere else I’ve used ZFS (mainly Proxmox) but I’m wondering if RAIDZ1 or RAIDZ2 would be a better option in this case?

Even using mirrors would provide 84 TB of usable storage which is 3.5X what we have currently and will be more than adequate for the next 5+ years.

4797
 
 
The original post: /r/datahoarder by /u/Old-Cloud1635 on 2025-01-05 14:12:46.

The ESUIT | Photos Downloader for Facebook™4.7.2 chrome extension is still able to crawl albums, but it has to be hacked, to download more than 300 images. I modified the entry for 5000 posts instead and will leave an archive with it here for anyone that wants to use it, you need to enable developer mode and select it's location after unpacking. Here is the modded extension.

https://preview.redd.it/v0us7nr7s6be1.png?width=1366&format=png&auto=webp&s=7bce4b4fcdac5fb6170179dafed70cd1b6ee86d7

4798
 
 
The original post: /r/datahoarder by /u/DavidGameDev on 2025-01-05 07:07:15.

Hi fellow Hoarders, I have recently become a dad, and now that we are going to have an endless amount of pictures and videos of the family, I am planning on storing those in a safe and privacy safe way. That for me means relatively easily accessible, on premise and with a long term backup solution.

Sofar I figured I would get a NAS with the leading product from Synology (Specifically DS923+ with some WD Red Plus 8TB) in combination with Lenovo ThinkCentre Tiny as a computational unit for e.g. docker or plex/jelly, paired with a M-Disk BD XL Backup solution, however I read that those M Disks are no longer M-Disks but just a cheap normal BD Disk.

Up until now I was using Pcloud as a single man, and I usually just stored project and non private stuff. But I want to get away from the cloud storage solution as mentioned.

I would use it obviously not just for family stuff, I want to stream with it content, run containers and maybe a gitlab with at least one runner for my Dev projects.

Does this sound kind of viable or would you suggest a different way as experts.

Thank you in advance for any help and suggestions.

4799
 
 
The original post: /r/datahoarder by /u/LockingSideways776 on 2025-01-05 23:31:46.

Recently shucked those 20TB Seagate USB drives. Got an unknown Barracuda drive, assuming it's SMR. I do not plan on using RAID nor backing my library up -- I only deem personal items worth keeping and I can always rebuild my library... Worth getting another one?

4800
 
 
The original post: /r/datahoarder by /u/Crafty-Run-6559 on 2025-01-05 23:14:26.

Just figured I'd post this for anyone else that's outside the US and ordering from SPD. Their policies for orders outside the US make it a bit risky.

I ordered 15 Seagate Ironwolf Pro 18tb drives with 5 year warranties.

One of the boxes had 100% DOA drives.

The other two had a mix of dented (but working) drives.

In total about 50% of the drives I got from them were either completely dead or dented.

They won't do an exchange because I'm in Canada. All they can do is a refund, where I can order the same drives again at a much higher price.

Overall this was my first experience with them, and it's been a huge let down, I basically have to return/refund all of the drives and go shopping again. My plan was to run 11 drives in raidz3 (and use the others for backups etc), and that's off the table with this many dead.

So buyer beware if you're outside the US, you may end up with a lot of dead drives and a headache having to return them.

I'll provide an update once I have full resolution, but I'm half expecting there to be issues with just getting a full refund even because of duties and taxes.

Edit: I ordered the ones mentioned in this post: https://www.reddit.com/r/DataHoarder/s/5RnwoDXobK

view more: ‹ prev next ›