It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
7551
 
 
The original post: /r/datahoarder by /u/Confident_Prize_8934 on 2024-08-09 22:02:00.

I've been building a PC for video editing and I'm extremely confused on the reliability of drives. I've looked into multiple brands and I find tons of stories of drives failing. I'm so confused on what I should do. Everyone seems to say that cruical and WD are the best drives but when I go and look for reviews on their website all it is, is people complaining about how their drives failed in a few weeks. Is that just a freak accident that happens sometimes? or is it more common on certain brands / M.2 VS SATA SSD.

I already plan on backing up everything onto another drive, and then into a cloud as well just to play it extra safe, but I really want to know what the best choice would be for an SSD.

a Sata / m.2 drive that is. I just want to know what brand is more reliable? or if you guys have any links that show me the differences between SATA VS M.2 ?

7552
 
 
The original post: /r/datahoarder by /u/LukeITAT on 2024-08-09 21:36:57.
7553
 
 
The original post: /r/datahoarder by /u/foodisgod9 on 2024-08-09 14:23:31.

Looking to upgrade from EX2, for some reason my drives keep getting unmounted by it self. I'm looking to upgrade to a 4 Bay setup, for home and family use.

7554
 
 
The original post: /r/datahoarder by /u/mxpxillini35 on 2024-08-09 13:46:13.

Ok, so I recently added three 5TB drives to my RAID5 setup (going from 6 drives to 9 drives). My HP Smart Storage Administrator is throwing an error code that one of the new drives failed. I noticed that there remains an active task "Logical Drive 2 is transforming". I'm assuming that this task is adding the new drives into the array.

So what happens now? I've removed the bad drive, but the task is still carrying on.

I'm assuming that I'm going to have to replace that drive, but I'm unclear on what kind of a process is happening at the moment. Is the system adding only 2 drives (making a total of 8 and not 9) and using 1 as a backup? Or is it "adding 3 drives" and effectively making the bad drive the "failed drive" in the RAID5?

Also, seperate question...the "transforming" process is moving really slowly. Like 10% in ~12 hours. Is that normal?

I've never added drives to an existing array before, so I'm more curious. All my data is still there, I'm not terribly worried. I just want to make sure I'm taking proper precautionary steps to clear the critical status messages that have popped up (pertaining to the failed/bad drive). I'm also curious as to the process that the computer is going through when adding drives to the array.

Thanks all!

7555
 
 
The original post: /r/datahoarder by /u/OundercoverO on 2024-08-09 13:31:25.

I have a small homeserver that I keep on 24/7. It was designed for power efficiency in mind, with an idle power consumption of around 20W and regular usage at around 25W.

I have a spare NVME disks refurbished from my old laptop that I want to use as extra storage, but no NVME slot on the motherboard, so I was looking for an adapter to connect it to a PCIe slot. My motherboard has one x1 and one x16 PCIe slot, so I would rather hook it up to the x1 slot.

I'm concerned with power efficiency. Browsing online reveals a lot of options, but neither comments on whether it is meant to be used 24/7 and how power efficient it is.

All of my build was made to save power, so an adapter that is able to deny the CPU to go in low powered mode can easily ruin its efficiency. Unfortunately I cannot afford to buy multiple adapters and test each of them individually.

Does anybody know of an adapter that satisfy these constraints?

My server's components were made using Hardware's LUXX spreadsheet as a reference of power consumption, which does not include any information regarding PCIe to NVME adapters.

Current specs, for curiosity sake:

  • Case: Fractal Node 804
  • PSU: LC-Power LC420-12 V2.31
  • Motherboard: Asrock H510M-HVS R2.0
  • CPU: Intel i3-10100F
  • RAM: 8 GB DDR4
  • Disks: 4 HDD connected by SATA ports
7556
 
 
The original post: /r/datahoarder by /u/cony_guppy on 2024-08-09 11:29:37.
7557
 
 
The original post: /r/datahoarder by /u/KaizoTrapper on 2024-08-09 20:50:45.

some days ago i jailbreaked my iPod Touch 2G and i wanted to download this game but i can't find it everywhere, i'll be really happy if someone have the ipa file of this game

7558
 
 
The original post: /r/datahoarder by /u/bladeguitar274 on 2024-08-09 20:35:34.

I can't seem to find anything conclusive, but does anyone know if you can use an optane drive to accelerate a storage spaces pool like you can with a normal single drive?

7559
 
 
The original post: /r/datahoarder by /u/AshleyUncia on 2024-08-09 19:30:54.

Original Title: After moving house, realizing I owned too many things and almost drowning in cardboard boxes, it took me four days to get the network and servers fully online. (This includes rebuilding an UnRAID drive from parity after moving, because it went bad just before packing and there was no time then)

7560
 
 
The original post: /r/datahoarder by /u/fancycakes on 2024-08-09 19:17:05.

Long story short, there is a local estate sale with 20+ filing boxes full of VHS tapes with movies recorded from TV. Lots of genres, and across many timeframes. I purchased a handful of tapes labeled with what I thought could be promising titles, to see if they truly had the content listed, and if they contained commercials, etc.

If these turn out to be legit, who/where can I go to make sure these can be digitized or otherwise preserved? I can probably store the collection for a limited amount of time, and while I have the very basics for digitization, I am nowhere near an expert, nor do I have the time or interest in taking on this massive collection.

Supposedly this whole collection will be given away tomorrow afternoon at the end of the sale, and I would hate for any "lost gems" to get tossed out.

What I picked up today:

https://preview.redd.it/9y668e7cuohd1.jpg?width=1920&format=pjpg&auto=webp&s=f1541a375220ff463ae37147a6c85448eadda5e8

7561
 
 
The original post: /r/datahoarder by /u/0xeli on 2024-08-09 17:24:55.

Hi I am looking for recommendations on how to create a setup where and I can confidently house my data at home safely

I have roughly 10TB of data of different qualities of necessity. Meaning there is some data that I absolutely cant loose and some that I would be find if was lost.

I have a main home server box and a pihole that I am hoping to use as a way to store my data and back it up.

I was curious what type of setup/tools you all could recommend to help prevent data loss, keep data safely encrypted at rest, and quick to retrieve data.

Thank you in advance !

7562
 
 
The original post: /r/datahoarder by /u/deutsch-technik on 2024-08-09 16:58:53.
7563
 
 
The original post: /r/datahoarder by /u/etherealshatter on 2024-08-09 16:34:28.

I have a server running ten hard drives (WD 14TB Red Plus) in hardware RAID 6 mode behind an LSI 9460-16i.

Last Saturday my lovely weekend got ruined by an unexpected power outage for my production server (if you want to blame - there's no battery on the RAID card and no UPS for the server). The system could no longer mount /dev/mapper/home_crypt which was formatted as btrfs and had 30 TiB worth of data.

[623.753147] BTRFS error (device dm-0): parent transid verify failed on logical 29520190603264 mirror 1 wanted 393320 found 392664
[623.754750] BTRFS error (device dm-0): parent transid verify failed on logical 29520190603264 mirror 2 wanted 393320 found 392664
[623.754753] BTRFS warning (device dm-0): failed to read log tree
[623.774460] BTRFS error (device dm-0): open_ctree failed

After spending hours reading the fantastic manuals and the online forums, it appeared to me that the btrfs check --repair option is a dangerous one. Luckily I was still able to run mount -o ro,rescue=all and eventually completed the incremental backup since the last backup.

My geek friend (senior sysadmin) and I both agreed that I should re-format it as ext4. His justification was that even if I get battery and UPS in place, there's still a chance that these can fail, and that a kernel panic can also potentially trigger the same issue with btrfs. As btrfs has not been endorsed by RHEL yet, he's not buying it for production.

The whole process took me a few days to fully restore from backup and bring the server back to production.

Think twice if you plan to use btrfs for your production server.

7564
 
 
The original post: /r/datahoarder by /u/Jatts_Art on 2024-08-09 16:22:37.

Evidently, according to Chrome, I'm being threatened that a handful of plugins I use will "no longer be supported" in the near future. Very vague, and I didn't notice this message beforehand until just today.

One of these said plugins is one I've used for many years and is extremely good and extremely useful; Fatkun Batch Download Image.

This plugin doesn't really have any main download pages anymore, not on Chrome Store nor any Githubs. So I guess that's why it'll be forced off Chrome browsers?

I'd prefer this to not happen, at all, but just in case does anyone happen to know of any alternatives? Personally, I am aware of basically nothing that comes close to it.

7565
 
 
The original post: /r/datahoarder by /u/XplorerAlpha on 2024-08-09 16:21:59.

For a home setup, personal backup Not business, Which NAS is best? Synology or QNap?

7566
 
 
The original post: /r/datahoarder by /u/Hopeful-Sport-3273 on 2024-08-09 16:09:39.

I found a cisco branded lsi 9266 8i for a good price and I'm worries that it is custom flashed and completely proprietary and that my avago megaraid manager software won't run on the cisco branded lsi card. Should I be worried?

7567
 
 
The original post: /r/datahoarder by /u/PdT34 on 2024-08-09 14:36:07.

I need a program that can help me batch merge jpgs. So I have around 1000 folders. In each folder there is approximately 5- 100 jpgs. I would like to merge the the 5-100 jpgs into a single jpg per folder.

What program would allow me to batch merge this so I don’t have to do each folder individually.

7568
 
 
The original post: /r/datahoarder by /u/Practical_Ad2464 on 2024-08-09 14:28:05.

Hi guys!

I'm working on a large and complex project, and I would like to ask you for some advice! I'm hoping you can help me ensure everything is set up correctly and running smoothly!

My goal is to connect my “Qnap TS-873A” with a “SymplyLTO Desktop SAS HH LTO-8” that I got at a great price on eBay.

To do this, I'm using an Atto “ESAS-H644” PCIe card to connect the LTO drive to my Qnap. However, it seems like drivers are needed for it to work, and I'm not very familiar with installing drivers on a Qnap NAS. Could anyone provide me a guide on how to install the necessary drivers on my NAS and which specific drivers I need?

I’ve already attempted to connect the LTO drive to a server running Windows 10, and I had to install SAS and PCIe drivers before the LTO drive could be detected by the software. I used Archiware and the IBM Diagnostic Tool to verify everything.

I’m also looking for alternative software to Archiware for my NAS, as its cost is quite high. The software needs to be approved for commercial use and can be a non-native app that runs on Linux or Python.

I’ve read that LTFS should be compatible since my LTO drive is newer than Gen.5, but the cartridge needs to be formatted to this format from an external device before the use. If anyone can confirm that ,this is a viable option to use some software’s than support this technology, though I'd prefer to consider it as a last resort.

Additionally, I’m considering the “IBM 3573-L4U TS3200 Tape Library”, which should support LTO-8 and be compatible with the SymplyLTO drives since they are partnered with IBM. I’m thinking about unmounting the case from the SymplyLTO drive and mounting the drive into the tape library with a sled. Please let me know if this is a possible option. If so, I’m also considering using a Raspberry Pi 5 to control the tape library, allowing me to mount and unmount the tape cartridges and transfer data directly from and to my NAS.

Any advice or suggestions would mean the world to me! I’ve been brainstorming solutions non-stop and would really need some help.

Thanks in advance! Byeeee :)

7569
 
 
The original post: /r/datahoarder by /u/salman2711 on 2024-08-09 12:36:09.
7570
 
 
The original post: /r/datahoarder by /u/ChuckleBerry5 on 2024-08-09 10:06:37.

Hey guys,

I’m looking for a way to automatically download and save new content (like media files) from a Public Telegram channel because I'm pretty tired of saving the new content manually a few times a day. I know that Telegram automatically downloads the content but it does not save them and they are not accessible files. I'm using a Windows 10 PC. There are many github projects about auto downloading stuff but I don't know how to use them.

Any help would be appreciated!

7571
 
 
The original post: /r/datahoarder by /u/thenolanful on 2024-08-09 10:00:28.

https://preview.redd.it/5fr21nhi2mhd1.png?width=673&format=png&auto=webp&s=dfc00bd6f366eb53bec3a219189dcb79f6f55fbb

I ordered a new 2TB Crucial SSD from Amazon but was met with this poor drive. I chatted with Amazon and tried to make them see why this is an issue, what if this had gone to someone who doesn't know how or that you should check drives? Someone out there sent this SSD back to Amazon and Amazon resold it as new (it was empty but already formatted). Amazon was no help so should I bring this to Crucials attention that Amazon is selling used drives as new? I'm willing to bet there's some people out there using a drive like this one as their main boot drive.

Curious what you all would do? Is it even worth it to bring up to Crucial? Would you feel comfortable sending this back to Amazon? I wouldn't want to mark the drive or physically damage it and send it back, lest Amazon say I broke it.

Its also wild that someone wrote 775TB to this drive alone... .775PB!

7572
 
 
The original post: /r/datahoarder by /u/-shloop on 2024-08-09 07:32:29.

Tool and source code available here: https://github.com/shloop/google-book-scraper

A couple weeks ago I randomly remembered about a comic strip that used to run in Boys' Life magazine, and after searching for it online I was only able to find partial collections of it on the official magazine's website and the website of the artist who took over the illustration in the 2010s. However, my search also led me to find that Google has a public archive of the magazine going back all the way to 1911.

I looked at what existing scrapers were available, and all I could find was one that would download a single book as a collection of images, and it was written in Python which isn't my favorite language to work with. So, I set about making my own scraper in Rust that could scrape an entire magazine's archive and convert it to more user-friendly formats like PDF and CBZ.

The tool is still in its infancy and hasn't been tested thoroughly, and there are still some missing planned features, but maybe someone else will find it useful.

Here are some of the notable magazine archives I found that the tool should be able to download:

Billboard: 1942-2011

Boys' Life: 1911-2012

Computer World: 1969-2007

Life: 1936-1972

Popular Science: 1872-2009

Weekly World News: 1981-2007

Full list of magazines here.

7573
 
 
The original post: /r/datahoarder by /u/mohamedhashad27 on 2024-08-09 07:41:11.

I have some videos files with special format and work only in special player that they create it how can i decrypt video

7574
 
 
The original post: /r/datahoarder by /u/Antique_Log_3112 on 2024-08-09 06:26:08.

Basic twitter scrapers don’t work for private accounts. Would screenshots be the best option then?

7575
 
 
The original post: /r/datahoarder by /u/techlover1010 on 2024-08-09 05:47:41.

so i want to store some files and access it maybe once a week or twice a week so it wont be on all the time.

if i understand nas correctly it combines all the drives into one storage. if thats the case then i dont want that . is there a nas solution or something that just lets me access each drive individually.

i prefer if the files is just in my home so no cloud solution for now but maybe in the future if i can afford it.

for now im just storing each one in a portable hdd and i have like 5 to 6 of those all varying sizes

view more: ‹ prev next ›