It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
4126
 
 
The original post: /r/datahoarder by /u/fmillion on 2025-01-28 06:29:48.

The main symptom is yt-dlp failing with an error "Please sign in to prove you're not a bot." It just started for me this week. I'm not a super heavy user of yt-dlp but I do use it to pull videos I particularly like/want to save. I don't feel like I've used it enough to be above the "noise" though - I'm definitely not doing what Nvidia supposedly did with downloading ~100 years worth of videos daily for AI training purposes (and apparently not being too cautious with that fact).

From all the research I've done, this has to do with Google starting to crack down on downloaders. The yt-dlp docs do have instructions for pulling cookies from a browser and even manually grabbing ephemeral (~12-hour) validation tokens but I have seen a few reports of people finding their IP banned completely, to where even a browser won't work (the mobile app apparently still does but nothing on PC works apparently with "something went wrong" errors). The only advice they have for you is "get a new IP from your ISP", since it seems Google has already blocked most known cloud hosting and VPN IP ranges.

I can't change my IP without a ton of hassle because I have a static from my provider. Obviously VPNs don't help (I tried - same error). I'm kinda nervous to actually use my login cookies - if my home IP gets fully blocked that would actually suck since I do watch a lot of tech news and just other general content on YT - I even pay for premium.

I can't even make a new Google account since it won't let me create one without an SMS loop ("to prove I'm not a bot"), and it says my number has been used too many times (I've done two junk/spam Email accounts with my number before - I've heard the limit is indeed 3 activations per phone number).

Just thought I'd start a thread to see if anyone else has had the issue, and what you ultimately did about it. Are full IP bans even if logged in really happening?

4127
 
 
The original post: /r/datahoarder by /u/serendib on 2025-01-28 17:09:55.

I am about to back up about 500 CD / DVDs of personal PC games. Should I rip these as BIN/CUE or as ISO? I realize that BIN/CUE are raw dumps of the disc, so is that preferred to ISO for maximum preservation?

If I need ISO later, can I convert to ISO directly from the bin/cue files?

4128
 
 
The original post: /r/datahoarder by /u/ak91hu on 2025-01-28 16:53:52.

Which is the cheapest solution? Shutterfly provides unlimited free storage for photos, but you need to place an order every 18 months to keep your uploaded photos accessible. The issue isn’t the price of the products but the cost of shipping.

4129
 
 
The original post: /r/datahoarder by /u/bobj33 on 2025-01-28 16:29:11.

We get a lot of posts about how tapes can last 30 years or more when stored in good conditions.

I would like to hear some actual experience with restoring old tapes either at home or at work.

What physical format and generation of tape? What software format? tar / dump / etc? When was the tape written? When was it restored? Were there any problems connecting the tape drive? Did the tape drive still work? Were there any errors with the tape either a few bad blocks or complete failure?

When I started working in 1997 the office had already existed for about 10 years. They had tapes on QIC-150, 4mm DDS, 8mm Data8, DLT III. I remember in 1999 having to restore some designs that were written 4-5 years earlier. I went digging through 20 boxes in a closet to find it but the tape itself was labeled well.

One of the drive motors was broken. It had sat unused for at least 3 years. We got another office to Fedex us their drive overnight. Had to buy some SCSI adapters to go from Centronics style to Fast Wide but it worked. Another 4mm tape had a few errors but they always wrote 2 copies and the other was okay. Our 8mm tape drive died but that was after years of multi-gigabyte daily incremental backups so it did its job well.

It would have been much better if they migrated the old designs to newer tape formats every few years instead of just leaving everything in boxes in the closet.

LTO-1 came out in 2000 and I see used LTO-1 tape drives for $20-50 on ebay so it should still be possible to read those 25 year old tapes but just curious what everyone else has seen.

4130
 
 
The original post: /r/datahoarder by /u/Spinnoox on 2025-01-28 16:05:46.

I just bought an external hard drive and I want to keep all my memories on it, but I will still use it on daily basis to exchange data with people and I don't want them to access my files.

Should I encrypt my drive with Bitlocker or use winrar to put a password on my files or is there a better solution ?

4131
 
 
The original post: /r/datahoarder by /u/FunkadelicToaster on 2025-01-28 14:46:59.

Just trying to salvage some stuff off my local secondary drive that is dying, it's been slow for a few months accessing stuff, but it's a spinner in an old machine so I hadn't thought about it.

I finally checked it with HD Sentinal and it's 3%... lots of warnings... I pulled it because my explorer started acting up and freezing...

4132
 
 
The original post: /r/datahoarder by /u/Venomica on 2025-01-28 14:34:55.

On top of wanting to leave the platform behind, one of my favourite artists has decided to leave themselves and I wanted to get all their art before they delete their account. I’m WILLING to go through and one by one download them but I really don’t wanna do that lol.

4133
 
 
The original post: /r/datahoarder by /u/alexpinkish on 2025-01-28 14:20:38.

I'm looking to store around 5 TB in the cloud and have tried a few cloud storage providers. I've narrowed down my search to MEGA and Hetzner Storage Share because they have good prices while offering fast and reliable service. And they show the filesize for folders!

I would like some advice and help choosing between them. I live in Europe.

MEGA Pros/Cons

  • 8 TB storage for 20 euros/month

  • slow uploads when uploading many files at once (at least on the free account I have)

Hetzner Storage Share Pros/Cons

  • 5 TB storage for 17 euros/month

  • based on Nextcloud

Has anyone used both services? How reliable is Nextcloud?

I have a Hetzner Storage Box and get great speeds, but it's FTP and I can't see folder sizes, which is a dealbreaker for me.

4134
 
 
The original post: /r/datahoarder by /u/Creepy_Finish1497 on 2025-01-28 09:46:32.

I'm new to the idea of purchasing refurb. My last purchase was 4 x 20TB WD Red Pro drives new for $350 each. I can't go back to smaller sizes and it does hurt to spend that much on a hard drive; so I'm now taking the plunge into the refurbs with 5 year warranties.

My threshold for pulling the trigger on a brand new drive was under $17/TB. I made an exception for the WD's because the 8 bay NAS they are in was a Christmas present and I needed to populate it with something :)

Anyway, from reading another post on refurb drive prices it seems like prices have gone up significantly. 4 of the 8 bays in my NAS are populated with the WD drives and I'm just over 50% full so I'm good with sitting on the bench for awhile.

What price per TB should I consider for my buy box? $10/TB? less?

4135
 
 
The original post: /r/datahoarder by /u/cum_cum_sex on 2025-01-28 08:32:54.

Here is the thing -

There is/was this incredible video by Ruhi Çenet but apparently its not available in youtube and I can see that it has a copyright strike. Journey to the Center of the Earth (It Took 8 Days, I Lost 10kg) was the link/title of the video.

I have downloaded the video from dailymotion and now want to archive it permanently and share it with others.

What will be the best way to archive it and share it with others so that others can watch it as well ?

Thank you!

4136
 
 
The original post: /r/datahoarder by /u/datsrym on 2025-01-28 08:12:22.

I had a problem with my LTO 6 drive and Windows 11. It would not format new tapes and it would not eject them. This post is just for people searching for a solution.

The work around was as stupid as can get. Right clicking and choosing eject would not work, neither would format. What I had to do was right click and choose show more options (Unsure of the translation as my Windows is in another language). Then I got the old Windows 10 interface. Then those options worked just as intended.

There is something wrong with the Windows 11 variant of eject and format shortcuts.

4137
 
 
The original post: /r/datahoarder by /u/JaKami99 on 2025-01-28 04:30:53.
4138
 
 
The original post: /r/datahoarder by /u/Dish_Melodic on 2025-01-28 04:06:58.

I have Dell PERC H730p Mini and set it as HBA mode. In this case, do I have same exact raw performance as "pure" HBA card?

The thing is: when I perform esxcli in VMware to check SMART data, most of the parameters are not shown N/A. I suspect H730 is not doing full HBA or something.

On the other hand, NVMe SSD that I installed direct to PCIe slot, it will show complete SMART data.

Let me know if anyone has knowledge on this.

4139
 
 
The original post: /r/datahoarder by /u/Juna_superfan on 2025-01-28 03:49:44.

I used:

gallery-dl "insert bunker url here"

with an album of videos and the works flawlessly

however with an album of several hundred images it slows to a crawl (2-3 kb/s) after 5 images, if it doesn't anything at all

Is there an argument to limit the rate of requests so it doesn't get timed out?

Thanks!

4140
 
 
The original post: /r/datahoarder by /u/HaydenB on 2025-01-28 03:33:24.

Anyone know if it's possible to run one or two SC200 enclosures off of two Dell R7XX HBA's so that both servers can access the data?

This diagram seems to show it

https://www.manualslib.com/manual/1290307/Dell-Sc8000.html?page=77#manual

I imagine it's just for high availability or accessing the enclosures drives without actually sharing the data together..

4141
 
 
The original post: /r/datahoarder by /u/Scary-Gur5434 on 2025-01-28 02:31:10.

Basically the title. I want to keep my concert videos for long term. I plan to replace both physical drives every 5 years. I also have the cloud.

4142
 
 
The original post: /r/datahoarder by /u/attacat42 on 2025-01-28 01:33:49.

I want to archive erotica and NSFW text posts from a variety of sources. Since the data only consists of text, storage space isn’t an issue, but I’m not sure what would be the best way to organise and browse it.

I’d like to have a web interface I can host, where I can add tags and other metadata such as the author, and search through the collection. Ideally, I’d also be able to add new entries directly through that interface.

What I want is essentially Stash, but for text. I’m aware of Paperless, but it’s way too heavy for what I want— everything would be plain text or markdown, not PDFs, and I wouldn’t need OCR or multiple users or any of the other features it has. Is there anything else that could work well?

Cheers.

4143
 
 
The original post: /r/datahoarder by /u/BioPho on 2025-01-28 00:09:27.
4144
 
 
The original post: /r/datahoarder by /u/igby1 on 2025-01-27 23:24:10.
4145
 
 
The original post: /r/datahoarder by /u/butmahm on 2025-01-27 23:14:31.

Zeroth thing - if this should be in r/techsupport or r/HomeServer apologies in advance; I was 50/50 where to go

First more problem context

  • This is my main NAS
  • Runs Unraid
  • SATA HDD as bulk storage and SATA SSDs as cache drives all go through the HBA
  • Every reboot is a gamble if all drives will show back up.
  • Rebooting again may have the drives show up again, may have others disappear.
  • I just reboot until they they all show up.

Second things - Hardware

  • Chassis: Supermicro 846
  • Backplane: BPN-SAS-846TQ
  • Mobo: X11SCM-LN8F (note just the 1 PCI slot)
  • CPU: Intel Xeon E-2276G
  • HBA: Dell H310 (IT mode) (in said PCI slot) only 1 port is used to the expander
  • HBA SAS Expander: HP 468405-002 24-Bay 6GB SAS Expander
  • SAS Expander power: PCI-E 1x to 16x Powered USB3.0 GPU Riser Extender Adapter Card

Thirdly... my questions

  • The aliexpress via amazon usb power would be my vote for a smoking gun but i just dont see a better way to rig it up at the moment. How would you?
  • Could my chain of Dell H310 --> HP SAS expander --> backplane just be poopy?
  • Are SAS cables known to be flakey?
  • Is it worth upgrading the HBA, expander, or backplane for better
    • Reliability?
    • Performance? Even for scrubs/parity checking? 99.99999% sure no as my network at the moment is 1G
    • Simpler cabling?
  • Do i just burn it all down and build a new server? Sometimes there just be gremlins man.

Fourth - The future...

  • SATA SSDs as cache drives
    • 1 x 2TB NVME as cache
    • 1 x 1TB NVME as cache
    • soon may either be 2x 4tb sata ssd for mirrored cache (have already and unused) or ill buy another 2tb NVME for mirrored cache
  • Would you go with more or faster cache drives ?

u/kingviper - If you're ever curious whats been going on with your old DAS...

4146
 
 
The original post: /r/datahoarder by /u/foodman5555 on 2025-01-27 20:56:04.
4147
 
 
The original post: /r/datahoarder by /u/InValensName on 2025-01-27 18:16:52.

My 16tb red pro has given it up, having been used as a mirror backup drive. It has never done anything more than receive a few gigs a day then spin down again. Interesting that the drive it mirrors gets far more use and is still just fine.

Luckily in this case it was the backup that failed, but I will say it anyway, do your backups. There was no warning at all, the drive literally worked perfectly and then didn't work at all.

Anyone in Canada done a WD drive warranty rma? Does the drive go to the USA? Our border guys can dream up fees for anything.

4148
 
 
The original post: /r/datahoarder by /u/Creepy_Finish1497 on 2025-01-28 09:22:49.

The ST20000NM002C is $260 and the ST20000NM007D is $290. In the product description both say certified refurbished and have the 5 year warranty. FWIW the ST20000NM002C says factory recertified on the label, while the ST20000NM007D says 'recertified product'. So for all practical purposes these appear to be the same, except their obviously not due to the price difference. So what gives?

4149
 
 
The original post: /r/datahoarder by /u/Dish_Melodic on 2025-01-28 07:56:40.

Something like: show me a pdf from company Z dated mm/dd/yyyy that contains conversation about data hoarder.

Then it will display the requested file in Explorer.

Could be a photo and video too.

4150
 
 
The original post: /r/datahoarder by /u/TouchOfStyle on 2025-01-28 06:54:31.

Got a updated android phone but seems like helium app no longer works to transfer across my app data particular some of the gaming save files which don’t have cloud online storage as an option

Checking if there a non root free or paid alternative that works with more modern android phone

view more: ‹ prev next ›