It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
9776
 
 
The original post: /r/datahoarder by /u/Nautricity on 2024-05-20 13:12:39.

Recently got ahold of A LOT of FREE server equipment, with drives, resulting in me now having nearly a petabyte of total storage combined. I’m very new to RAIDs and server setups in general.

My question for now is, what’s the best way to refresh these drives to achieve optimal performance before deploying them? Most of these drives have multiple 10s of thousands of hours on them.

I have a mix of Apple Xserve RAID, Dell PowerEdge, HP ProLiant, Cisco UCS, etc branded servers and RAID arrays, ranging from 250 GB HDDs all the way up to 8 TB HDDs.

Is there any sort of specific software that’s recommended to “refurbish” these drives in mass? Bonus points for macOS (64 bit) and OS X (32 bit) compatibility!

Thank you all for any help as I’m very new to this!

9777
 
 
The original post: /r/datahoarder by /u/Heavy_Telephone_3150 on 2024-05-20 10:44:48.

it's better if it's free

9778
 
 
The original post: /r/datahoarder by /u/BlossomingPsyche on 2024-05-20 05:48:14.

Let's say you regularly have files with extraneous tags that you might want to remove (ie renaming something from MyDVDMovieRip1981/MyDVDMovieRip1981.x264.mkv and with perhaps a script / command (I can do this on Os X with an application called Alfred) rename the folder, file and categorize it in the way I want (ie Horror, Scifi) so my Alien1994Bluray/AlienRip1994.mkv would get stripped of the tags and then renamed with a naming scheme like if I wanted to do a scifi rename on my mac I would type "shift-command space to activate alfred then "sort Alien 1984 1080p Scifi" which then renames the selected folder to Alien [1080P] [SCI-FI] [USA] [1984] and the file to Alien 1984 1080P.mkv which then gets dropped into plex. Is there something that will let me rename files/folders with a 'format' like this for PC ? Kind of like automator or alfred or raycast for Os X ?

9779
9780
 
 
The original post: /r/datahoarder by /u/zannare on 2024-05-20 03:18:19.

I recently purchased a refurbished HGST 12tb hard disk (HUH721212ALE601) to use as an additional parity disk in my Snapraid setup

it seems to work well, the smart is ok and completed the sync without problems (about 23 hours) but I was unable to make it go to standby automatically

I tried all the APM values from 1 to 127 (default was 254) but nothing changes
I tried various settings of the time in which it should go to standy with smartctl, but nothing
manual standy works with both smartctl and hdparm

the hard disk makes a "tick" every 5 seconds
https://vocaroo.com/148gEPXcUo36

9781
 
 
The original post: /r/datahoarder by /u/Sorry_City_3685 on 2024-05-20 02:35:52.

Original Title: The team responsible for archiving Rooster Teeth content is willingly removing uploads from Internet Archive at the request of the creators. Much of this content was exclusive to the Rooster Teeth website and is no longer available anywhere else following its shutdown.

9782
 
 
The original post: /r/datahoarder by /u/Anthonyb-s3 on 2024-05-20 02:25:03.
9783
 
 
The original post: /r/datahoarder by /u/RedStorm1917 on 2024-05-19 23:57:19.

My school email will be axed within a month, so I have to transfer files from my drive to another account using the Google Takeout transfer process. I started it yesterday, and some files have now just been copied and transferred to my new account. But the details of the copied files don't show the date the original file was created, only when it was copied. Also, the files don't appear to be created in chronological order based off the old drive. Is there no way to see the date the original file was created?

9784
 
 
The original post: /r/datahoarder by /u/M4dh77r on 2024-05-19 23:52:53.

Hi guys I did really search the Reddit but I could not find any information on controlling fan speeds I have a new to me Aberdeen 45 Bay DAS which is just a Supermicro in drag but my temps are a little high and I have no idea how you would go about adjusting the fan speeds on this or if they're even adjustable I hear the PTJbod CB3 has IPMI and you can control things that way I would love to upgrade to that if anyone knows where to find them I can't find it anywhere I would truly appreciate any input thank you guys ....

https://i.redd.it/esxgb3qx0h1d1.gif

https://preview.redd.it/8wax02qx0h1d1.jpg?width=4320&format=pjpg&auto=webp&s=231b43ef9956fe12a16f5ba594ffffba7f825076

9785
 
 
The original post: /r/datahoarder by /u/SCDUDELEX on 2024-05-19 22:32:56.

Current status: Using the 5 Bay station... been working very well (and yes have a 6 Bay NAS as well, different functions in my system):

I need to expand the bay capacity and assuming others have gotten to this point. Question is, pros and cons of adding another Sabrent 5 bay and using the second USB C to connect the two. Versus, retiring the 5 bay and swapping it out for the 10 bay model.

Obviously it's nearly twice the cost to grab the 10 Bay, but that choice would leave me with the "old 5 bay"; to maybe do something with. But is the single usb connection an advantage over the daisy chain of two 5 bays?

Anything else I should consider?

Thanks in advance...

9786
 
 
The original post: /r/datahoarder by /u/ahmadmughal0 on 2024-05-19 19:06:26.

What the title says, also it's in a third world country so it's not soo cheap for me, but cheaper than a new one. Is it a good catch? A 256gb ssd will be fine for me since I have a 1tb hdd buts it's slow/5400 rpm, in 2017 hp omen) but I'm wondering should i get this cheap with 71%health or a 256gb one new?

9787
 
 
The original post: /r/datahoarder by /u/Merchant_Lawrence on 2024-05-20 00:57:15.

Hello everyone, i currently try set up my own nas for archive stuff and on tight budget around 55$ i found on local online shop offer seagate expansion (without mentioning what number or series) 2 tb for just 12 $, it have good rating, are it good choice for long term or it not good ? thanks.

link on that local online shop (it say tosiba but option available are seagate) : https://shopee.co.id/Hardisk-Eksternal-Toshiba-2TB-1TB-HDD-USB-3.0-Portable-External-Hard-Drive-Hard-disk-i.997456609.22981243111?sp_atk=abc600c5-5d08-4044-ba64-5c73626f8ba5&xptdk=abc600c5-5d08-4044-ba64-5c73626f8ba5

9788
 
 
The original post: /r/datahoarder by /u/Lj_theoneandonly on 2024-05-19 22:09:28.

I've followed the guides on this sub for extracting whatsapp backup on android to pc with success. But i haven't seen as much useful discussion around trying to do the same with iPhone. I currently have a couple gb of whatsapp data in my icloud that I encrypted using the 64 digit key. I was looking for ways to take this encrypted backup out of my old iphone but the process doesn't seem to be straightforward. All i've found online were a bunch of third party sites like "Dr Fone" which several posts here have vouched for as a scam. So uhhh is there anything else I can do? I wouldn't mind jailbreaking the phone since it's an old one anyway. Thanks in advance for any help!

9789
 
 
The original post: /r/datahoarder by /u/Subversive_Lovelorn on 2024-05-19 22:02:47.

I have several 4TB Seagate external hard drives that I purchased nearly four years ago, and I am curious about how much longer they might last.

9790
 
 
The original post: /r/datahoarder by /u/DazedWithCoffee on 2024-05-19 21:48:57.

I've got a 4TB disk that just degraded my RAIDZ2 pool with 16 read errors. I've got a replacement ready and the appropriate backups already in place, so there's no risk of data loss. My question is this: what to do with this drive? I'd hate to toss it, but I don't particularly trust it anymore. Has anyone found a low-waste strategy for dealing with these things?

9791
 
 
The original post: /r/datahoarder by /u/behbop on 2024-05-19 21:32:27.

For example I just copied 5,000+ photos and videos to my new WD Elements External Hard Drive and its only letting me view one file at a time. When I click on a picture and would like to move on to viewing the next one, there is no forward arrow. I have to exit out of the photo and double click on the next file. As you can imagine this is annoying and inconvenient. How can I fix this? On Windows 11 btw not mac

9792
 
 
The original post: /r/datahoarder by /u/Far_Marsupial6303 on 2024-05-19 20:53:01.

Posting for visibility as an addendum to this thread. https://www.reddit.com/r/DataHoarder/comments/1cu2301/finally_after_seven_years_a_6tb_25inch_external/

I was looking at the WD site and noticed they have other models beyond the WD Black external and there are spec sheets for them. They are not listed

To those who wonder why the height is important, max 15mm height for 2.5" drives has been the standard for may years and is the largest height allowed in 2.5" enclosures.

The 5TB MyPassport case is 19.2mm and the drive is 15mm. The 6TB is 20.6mm so the drive is probably 16 or 16.5mm to accommodate the additional platter. I suspect this may allow them to fit snuggly in some 15mm cases. For reference, the lowest height 3.5" drive is 19.5mm.

https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/public/wd/product/external-storage/my_passport/my-passport-phdd-usb-c/data-sheet-my-passport-phdd-usb-c.pdf

https://documents.westerndigital.com/content/dam/doc-library/en_us/assets/public/wd/product/external-storage/wd-black-p10-game-drive-for-xbox-usb-3-2-hdd/data-sheet-wd-black-p10-game-drive-for-xbox-usb-3-2-hdd.pdf

Pricewise, the "bargain" ;-p, is the Elements SE at 169.99MSRP, vs $129.99 for the 5TB.

9793
 
 
The original post: /r/datahoarder by /u/dtf_0 on 2024-05-19 20:49:42.

I was wondering if any NAS hardware/software allows a user to configure powering-down drives/enclosures for storage pools designed for archiving.

I am a robotics engineer. I have a lot of old sensor data that is used very infrequently. Whenever we release a new release, we run a simulation against old data to ensure there are no regressions. However, this data is only touched at max 30 days per year.

Currently, I manually turn on my archive NAS when need, run my test, move any new data to the archive, and power down the NAS manually.

I am curious if there is any hardware or software that can do this automatically. I am thinking of something like a disk enclosure or disk shelf that contains an 'archive pool.' When I access the archive pool, the enclosure powers up, attaches the pool to the NAS, and works as normal. Then, after some delay, the pool detaches and powers down.

This is more about power consumption than wear and tear. I currently average about ten years of life out of my drives. They start their lives as constantly spinning drives in my primary NAS, and then when I replace those drives with larger ones, they move to the archive NAS, which runs infrequently.

9794
 
 
The original post: /r/datahoarder by /u/wellnowholdon on 2024-05-19 20:25:14.

Hello hello,

If this is in the wrong place let me know.

Recently, I subscribed to a website with some embedded SketchFab models available for viewing and interaction. Resultingly, it appears that I have been granted (for an expensive and limited time) indirect access to a very rich repository of engineering models that feature various diagrams, cutaways, animations, and annotations.

This access allows for interacting with a variety of models, viewing associated educational annotations, and watching demonstrative animations that illustrate the working principles of the modeled object.

Using Chrome, via the Network tab, I am able to see some line items of interest. These are firstly, *.binz files, alongside what appear to my eye to be associated texture maps, normal files, and so on as a variety of .jpeg files. There are also links to the sketchfab.com domain and similarly structured API calls.

I am aware and have investigated the path leading to .binz extraction and conversion. That is not what I'm interested in. It is not a raw 3D model that I am seeking, it is this comprehensive experience. Having access to the base model is all well and good, but what I would like to do is preserve this "SketchFab Viewer" experience even after my membership ends with this website.

So, I would like to ask assistance.

If possible, could pointers be provided to a way for me to preserve offline the material I currently have access to? Alternatively, is there a method to somehow extract a SketchFab link that will persist after my membership expires?

Thank you.

9795
 
 
The original post: /r/datahoarder by /u/tater1337 on 2024-05-19 19:22:53.

Honestly I tried searching here, but either I get confused or I cannot tell is the solution will fit my needs

I have

[windows]

my main PC

work laptop

a second home machine that does some tasks that I don't want on the main PC (like housing all the backups)

personal laptop

a bunch of loose hard drives, both SSD and HDD with data that I might want in the future(grandparents disks full of photos type stuff)

a PC set up as a DVR for a bunch of security cameras(not wanting to save the footage, just an easy restore if something breaks and a reinstall is needed)

Linux

a couple of PCs used for Minecraft servers

a PC set up for home assistant

a couple of netbooks, some have software for 3d printers, CNC machines, Laser engravers, etc

a whole load of raspberry pi's with various weird stuff

a stack of DVDs and CDs that I'd like to have backup copied in case of physical damage

right now I have some backups of some machines, but I have not been able to get everything backed up

my plan

take my recently purchased 16tb drive and dump everything on that, then get another drive to copy the first (or expand)....THEN set up a backup physically somewhere else

what are my options? I've cloned drives with FileZilla, but only on a "copy this HDD to a SSD to improve old machine", not for backups

I tried to get windows backup to try to backup my main PC to the secondary PC, but it fails more often than it works

getting Linux and windows to play nicely together seems like black magic. more comfortable in windows than Linux

tutorials, software options desired, dedicated NAS hardware solutions or cloud are not

9796
 
 
The original post: /r/datahoarder by /u/BatteryAcidEnj0yer on 2024-05-19 17:36:24.

I have a folder of "family pictures" and would like to have i back up automatically every few days from an m.2 ssd to a HDD (in the same PC) . The folder is about 200Gb+ so I'd be best if It would only copy new files.

Preferably using built in tools or opensource solutions

I'm using windows built in solution ( backup and restore (windows 7)) but I'm unsure if there is a better, more efficient and/or more reliable solution

9797
 
 
The original post: /r/datahoarder by /u/Coloradozonian on 2024-05-19 17:27:10.

Hey there! I'm trying to simplify my digital storage, use one provide, and cut down on subscriptions. As a photographer, mom, and blogger, So naturally 've accumulated a ton of photos, files, and albums, but they're all over the place between iCloud & Google One, I pay 2TB with each provider! Sometimes my photos do not upload to both clouds, and i go crazy trying to find it.

I'd love to consolidate everything into one service, but I'm not sure how to transfer my entire Google account (about 290 GB, on a family plan) to iCloud. Or vice versa! Is there an easy way to do this? Maybe an app or a hack that can help? I'm somewhat tech-savvy, but, I'd appreciate any guidance!

Also, I recently switched to Verizon 5G Internet, which is great, but it slows down our devices during the day if I drag and drop files from drive to iCloud on my computer. So, I need to transfer files at night, which is a real pain.

Any advice or recommendations would be a lifesaver! Thanks in advance!

9798
 
 
The original post: /r/datahoarder by /u/fgt67cam on 2024-05-19 17:00:22.

I recently purchased a LTO-5 tape drive to back up some HDDs. The drive itself is working and connected via FC using a QLE2562 PCI-E.

My plan was to original create a SAS RAID 0 to temp store the files being written to tape from the offline HDDs but I've had issues with the P410 controller not working so for now will have to connect the offline SATA drives to the server (Proliant ML330 G6).

The drives I'm using aren't fast (ST3500312CS) but I did a read speed test using dd if=mytestfile of=/dev/null bs=1M count=1024 and they're getting around 80-90/MBs and online speed results show roughly the same. It's not fast but should be enough to do one backup copy before trying to fix the SAS issue.

I've timed how long it's taking for it to do each file and the results:

File 1 - 309 seconds - 10,045,430,602 bytes ~32.5/MBs
File 2 - 291 seconds - 13,597,137,146 bytes ~46.7/MBs
File 3 - 302 seconds - 13,967,991,165 bytes ~46.2/MBs
File 4 - 94 seconds - 4,526,005,392 bytes ~48.1/MBs
File 5 - 113 seconds - 5,139,777,083 bytes ~45.4/MBs
File 6 - 107 seconds - 4,917,953,848 bytes ~45.9/MBs

As first it seemed like the culprit was the HDDs so I installed a Samsung EVO 850. It scored 226/MBs with the same read test so much faster than the HDDs. I then had it write a 34GB file to tape and it took 528 seconds (not including tape rewind time) coming in at ~69.1/MBs which is still slow so I don't think the bottle neck is the SATA drives. The FC card is showing the link speed as 8Gbps and even if it was 1Gbps it's still too slow so I don't think it could be that. All that's left is the tape drive or Debian/drivers/software. I'm using "tar cvf /dev/st0" to write data to the tape.

9799
 
 
The original post: /r/datahoarder by /u/johnklos on 2024-05-19 16:05:52.
9800
 
 
The original post: /r/datahoarder by /u/retrac1324 on 2024-05-19 15:15:29.
view more: ‹ prev next ›