It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
8301
 
 
The original post: /r/datahoarder by /u/Sophenyl on 2024-07-13 18:10:13.

Original Title: Appreciation Post: Thank you to those of you that have the money and time to collect things like romsets, movies, shows and so on and make them available (even temporarily) when the source innevitably gets taken down. When I can afford to responsibly join your ranks, I will.


Shout out to the countless discord sharing channels and forums and especially the brave places with a very out and open online presence like just straight up browsable website, I have no idea how those stay up for any amount of time before ISPs ban them. Apologies if this kind of post isn't allowed, I checked the rules and couldn't see anything prohibiting a thankyou post.

8302
 
 
The original post: /r/datahoarder by /u/Rafa130397 on 2024-07-13 17:02:28.

Hey guys!

I have a quick question, I run my homelab in ubuntu and sometimes I have some power outages. I am noticing (due to some errors I see) that the hdd drives that are inside my Terramaster disk enclosure, stop getting recognized after rebooting the server after the power outage. I do have to say that the disks that are not inside the disk enclosure (external hdds) are properly recognized.

Does anybody know how to fix this?

This is the enlclosure:

https://www.amazon.com/gp/product/B08CN4Z4PC/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1

Thanks!

8303
 
 
The original post: /r/datahoarder by /u/stilljustacatinacage on 2024-07-13 16:38:44.

Original Title: What is this behavior in JDownloader 2? Downloading a ~400 GB folder (50-250 MB individual files) from Internet Archive, it will download at 100-250 KB/s for ~2 seconds, stop, resume, stop, resume... Am I throttled? I finished downloading a different ~400 GB archive a few days ago without incident.

8304
 
 
The original post: /r/datahoarder by /u/Zhyphirus on 2024-07-13 16:09:17.

Hey, I've been searching and planning for quite some time already, and I'm still not 100% sure about this, but someday it'll have to come out of the paper. My whole idea boils down to this setup: https://pcpartpicker.com/list/r2LrN6, I plan to start off strong with 60TB in a single zdev using raidz1 in a TrueNAS. Unfortunately, I need to risk less redundancy for more speed/size since, prices are insane, and I don't have a lot to work with (I'm not based in the US), so none of those were really my first options, but trust me, I've searched for different cpus, mobos, cases, hdds, but I ended up those, since they are basically the "best" options I got, between price and availability. I do plan to do a 3-2-1 in the future, but not sure too, this is probably going to be more of a media only NAS, I don't really plan on placing anything else that could be critical and really would need a backup.

So, after all that, here's my questions:

  • Should I be worrying about something else that I didn't really plan, and does this sound "ok" so far?
  • I don't think I can really afford 3 20TB hdds all at once currently, so what should I do to begin with?
    • Start with smaller hdds and build up from there
    • wait up for a good deal (or for more money) and get all 20tb at once
    • or does truenas zdev allow me to replace smaller drives with bigger ones, one by one, so I can start with 3*4tb for example, and then replace them with 20tb as I go?

Thanks, and LMK if I got something really wrong, since I don't really know what I'm talking about yet, everything is just based on the research that I did.

8305
 
 
The original post: /r/datahoarder by /u/Ghostconn on 2024-07-13 14:56:33.

After being unsuccessful with post in other communities I thought I'd ask the experts. I recently purchased game pass and want to install my games to my truenas share. I have the share mapped via SMB. Steam and epic allow me to natively select my network storage and I have no issues playing games. Gamepass is give me a hard time with this. My only option is to store games on local storage. I even tried creating a symbolic link thinking it might trick it... Nope. This is really pissing me off. What are my options? There must be a way

8306
 
 
The original post: /r/datahoarder by /u/Sea_Anteater_3270 on 2024-07-13 13:07:52.

Is the terramaster d4-300 a good choice for plex storage? Is there anything better or just as good for the same price or less. Thanks

8307
 
 
The original post: /r/datahoarder by /u/Sea_Anteater_3270 on 2024-07-13 13:07:38.

Is the terramaster d4-300 a good choice for plex storage? Is there anything better or just as good for the same price or less. Thanks

8308
 
 
The original post: /r/datahoarder by /u/d_r_ on 2024-07-13 12:13:11.

I have a NAS with about 4TB and my PC with about 1TB of data that I want to be safe even if my place burns down or everything gets stolen. NAS data rarely updated, maybe once a month new files are added/moved. Big parts of the data on my PC changes on a daily basis.

Requirements for the backup:

  • Updating the backup should be reasonably easy (which is why I'd prefer some kind of backup over the Internet vs. having to deal with physical disks that I need to bring to a safe place and hope that they don't get stolen while I update my backup at home)
  • Client-side encryption, I do not trust anyone else than myself
  • Quick updates of the backup, i.e., a few hours at night should suffice (NAS & PC are online 24/7)
  • Restore must be possible within a week, i.e., either the connection is that fast when recovering OR I get my hands on a physical disk within a week (I'm living in Europe)
  • Some kind of protection against encryption trojans, e.g., even if I realize only after a few days that some files are encrypted I want to be able to get them from my backup in pristine condition. If the backup immediately removes the "old" unencrypted version with the "new" encrypted one it doesn't help my case very much

Non-requirements:

  • Initial backup can take up to 2-3 weeks, I don't care so much about that
  • Very easy to use, I'd prefer a nice UI, but I'm tech-savvy to use a CLI as well

Any suggestions that are as cheap as possible?

What I've used so far:

  • CrashPlan: according to the Internet recovery of my 5TB is nearly impossible as it is WAY too slow
  • iDrive: didn't hear much better news about them unfortunately

Please help me out. I'm scared to go for another CrashPlan any pay for no security. I started to bring physical disks to my parents every few weeks, but that doesn't cover my daily data good enough and it is cumbersome as hell.

8309
 
 
The original post: /r/datahoarder by /u/Mammmmaluigi on 2024-07-13 11:15:44.

my primary rom source has always been archive.org, now that i got 5x3tb hdd, i want to preserve them.

for personal use, I can't host any files here in my country.

8310
 
 
The original post: /r/datahoarder by /u/Daspineapplee on 2024-07-13 10:56:58.

Hi ya’ll, I hope I can post this here!

We run a 200+ tb file server at the office which currently stores 50tb in total. The system is build in a large case for this exact purpose.

We have a video production agency and we work with large projects and files. So we fill around 1tb up to 10tb in some rare cases per month.

We don’t have a backup solution on another location however. I still want to get one up and running at home. Both for safety purposes and for work at home/homelab usage.

The backing up will not be a problem and something I’ll do manually since both my internet at home and at work aren’t fast enough to transfer a terabyte or more per pop.

My problem however, is that I don’t have a large apartment and I don’t want this huge rack/case in my living room. I also don’t expect to fill the fileserver at work anytime soon. So I’m looking for something a bit smaller.

Does anyone have good ideas/experience with something like this? I never worked with off the shelve nas solutions and I wasn’t a big fan of expansion bays in the past (We got a nice to get rid of all those ssd’s and hdd’s and I didn’t want to replace those with basically another standalone product). I’d like to take this opportunity to get some extra storage at home as well if I can and if I can do that safely.

I hope to fill it with at least 100tb, hope for 200tb although this may be unpractical for size purposes.

10GB ethernet is a must, both for the first time when copying the data from the mother system and for video editing work at home.

8311
 
 
The original post: /r/datahoarder by /u/Sea_Anteater_3270 on 2024-07-13 09:37:02.
8312
 
 
The original post: /r/datahoarder by /u/Altruistic-Music-435 on 2024-07-13 08:17:36.

I'm wanting to make some mods to the Crash Nitro Kart 3D game for Zeebo. (it was also released for iOS, N.Gage 2.0 and Symbiam)

But everything I looked for related to .vfs files didn't work, I read on a forum about a guy who managed to extract the data.vfs with a script in QuickBMS, I managed to find one from Porlabit Crash Nitro Kart 2 but it didn't work with Nitro Kart 1 so I ended up running out of options.

Also, after extracting the file, is it possible to compress it again so that the game can work with the new modified file?

[EDIT]

Kurabupengin sent me the QuickBMS script he used to extract the files and it worked with data.vfs from Zeebo's Crash Nitro Kart 3D.

I managed to access the image and audio files, but there were some strange files that I couldn't identify.

https://preview.redd.it/zgw530aiv8cd1.png?width=1200&format=png&auto=webp&s=25c5a9145d352f66b26221fb3a726dc90e3a2a95

But my problem now is after making changes to textures, music, sound effects, I need to compress the data.vfs again, how do I do that?

I know that most Polarbit games ( Raging Thunder 2, Reckless Racing, Armageddon Squadron, Iron Sight, Crash Nitro Kart 3D and Crash Nitro Kart 2 ) have a "data.vfs" so I think if I could find a way to extracting and re-compressing Crash's data.vfs will probably be possible to do the same with other games and create new mods.

Here are the extracted files and the Quick BMS script if it helps anyone to find a solution: https://www.mediafire.com/file/bjc5bmvexvro2gl/data.vfs_extracted_and_bms_script.zip/file

8313
 
 
The original post: /r/datahoarder by /u/techlover1010 on 2024-07-13 04:53:29.

so i have lots of videos and i want a way to add tags, bookmarks (with tags or description), loops (with tags or description) to the video without touching the video.

i dont want it (method or tools) to touch the video itself that will cause it to change md5 or checksum or anything.

this will help me greatly in searching or just browsing parts or segment of the video that i want to watch at that point in time.

is this at all possible?

8314
 
 
The original post: /r/datahoarder by /u/froggygun on 2024-07-13 04:41:10.

I've used yandex to reverse image search some references for art. The issue is that I can't find the original art because the post on the website has been removed. Yet yandex still shows all the pictures on that post. I've tried putting in a link and it only shows a couple images I was looking for but keeps giving results from other sites. I put in different keywords and some images of the site I'm looking at showed up. So I'm hoping somewhere I can get something to SHOW all the images on the site post.

I would like to know if it is possible to have the link. And to have yandex list all saved/archives images on the site.

Yandex shows the images with the correct original post link/name. So I know they must be stored somewhere on the web or yandex. Wayback machine did not work :(

So putting in the post name(example space art) in yandex lists only a few specific image I'm looking for. But also giving random other images related to the name "space". So the specific image I am looking for is buried under tons of random other space images.

I have also tried "on the site" filter but it shows the WHOLE site instead of a specific page/post

8315
 
 
The original post: /r/datahoarder by /u/Kended on 2024-07-13 04:00:35.
8316
 
 
The original post: /r/datahoarder by /u/DoughnutTechnical647 on 2024-07-13 02:30:18.

Hey guys,

I just found some old BBC radio programs that I want to listen to on archive.org. I'd like to download them so they're easier to listen to on the go but they are 'stream only'. How do I download them? I've located the direct MP3 URL by going to 'view page source' but I still can't figure out how to use that to download it. Right clicking on the page just saves an mhtml. file.

8317
 
 
The original post: /r/datahoarder by /u/drhappycat on 2024-07-13 02:07:52.

Do they only recognize WD drives or can I use the enclosure with a different brand drive, like Seagate?

8318
 
 
The original post: /r/datahoarder by /u/ElleCerra on 2024-07-13 02:05:57.

So I picked up a Sony CCD-TRV138 at a garage sale and I decided I'd like to take some video and digitize it. I've been doing some research and it seems I have two options and I'd like some advice on how to proceed.

I used this link here to get most of my info

Step 1 is the same for both options but I'm including it in case I'm wrong from the start.

  1. Record video on camcorder and use as playback device, use AV out 3.5mm jack with S-video

Option 1

  1. Plug S-video into Canopus ADVC-100
  2. Plug Canopus output into FireWire to USB adapter in PC
  3. Record with VirtualDub with specifications outlined in above guide

Option 2

  1. Plug S-video (or RCA) into analog to digital converter
  2. Take HDMI output of converter and plug into capture card (Elgato HD60 S+)
  3. Record Elgato with OBS

I'd prefer Option 2, as it only requires me to buy the analog to digital converter, but I'd really like to get the best quality possible without spending much more than $200 total.

Questions for Option 1:

I'm wondering if the FireWire to USB adapter is a good option or if there is a loss of quality there? Am I better off using an integrated FireWire card?

Is there something I can use other than the Canopus ADVC-100 that provides the digital signal directly to an HDMI cable?

Questions for Option 2:

Is there a preferred analog to digital converter that goes directly to HDMI that isn't total shit? I've bought a few for playing retro games on HDMI only TV's and they've typically provided poor quality performance and break quite easily.

8319
 
 
The original post: /r/datahoarder by /u/artsyfartsy12345 on 2024-07-13 01:52:28.

I am looking for a program for the laptop or an app for my android or hell I could even dust off the Kindle fire if need be, but I want to hoard ALLLLLLL of the data for my succulent collection. The plant apps are just not enough. I don't care about ID-ing anything or watering reminders or tips on how not to kill them. Cuz spoiler....I'm gonna kill them. But I want DATA! I want them numbered. I want them charted. I want progress pictures. I want to search my collection for keywords in my notes. I want to keep track of my different experiments. Can someone point me in the right direction and pat me on the head please? I'm not scared of research, I just had a high light bulb go off that this was the place that would have suggestions. TIA

8320
 
 
The original post: /r/datahoarder by /u/leolecal on 2024-07-13 01:44:28.

Hey guys, how are you?

I'm an amateur photographer from a somewhat poor country, and after some data loss, I want to do it properly this time without breaking the bank.

I have a PC with two SSDs: one with Windows and apps, and a 1TB drive as my 'OneDrive' backup, which is 60% full. Everything I put there goes to the cloud.

This past year, I've been taking my photography more seriously and shooting a lot. I don't want to delete anything because my taste may change, and I want to preserve the possibility of finding new gems in my collection.

My idea is to buy three 2TB SSDs: the first two in RAID 1 and synced to the cloud, and the third one I would connect via USB at the end of every month for backing up the other two.

Is this a good idea? How can I improve without wasting my money? I don't have the means to buy a NAS system nor the room to build a custom server. I'm familiar with the 3-2-1 concept; do I fulfill it like this?

Thank you in advance! 😁

8321
 
 
The original post: /r/datahoarder by /u/ChamberofSarcasm on 2024-07-12 23:25:25.

Hi everyone,

I grabbed a comic archive from archive.org and thanks to this amazing group, I ran the RAR through VirusTotal. 2/3 of the files were clean but as youll see in the screen grab there were a lot of question marks. Seems unsafe to download, no?

https://www.virustotal.com/gui/url/b47c31df2cb8e50f429335ab8d1598cf1607e5c3e04f46fe9c7df0e571c3ffc5/detection

https://preview.redd.it/qx5y3zc1u5cd1.png?width=2692&format=png&auto=webp&s=98d1a9d3a52c6fff9d9307c0112ac6ec819004b7

8322
 
 
The original post: /r/datahoarder by /u/Duck_Dur on 2024-07-12 22:47:12.

I have been looking into it for a while now, our family has a load of really old home movies/family photos that I have been meaning to digitize over the years, would it be worth getting a NAS exclusively for this?

8323
 
 
The original post: /r/datahoarder by /u/GreenCold9675 on 2024-07-12 22:35:00.

apparently equivalent to: LSI SAS9206-16E

but I've read better to get the Dell one for robust longevity.

Dunno if "1V1W2" is important?

Will use for TrueNAS SCALE, maybe UNRAID one day, with 16x SATA3 HDDs in a JBOD backplane enclosure.

I want a new one, not used, so I guess that means I must do the flashing myself of the "IT mode" firmware? Download link for this specific model?

Or even a purchase link from a reco vendor? Budget under $100

...

In my notes I copied

for SATA use a SATA controller, not SAS

Does that mean there are better choices for my use case?

I only have x8 lanes of PCIe 3.0 and really prefer low profile short length, physically small as possible.

8324
 
 
The original post: /r/datahoarder by /u/boyididit on 2024-07-12 22:06:35.

For a backup drive of plex media player

Should I use MBR GUID!

8325
 
 
The original post: /r/datahoarder by /u/Void-ux on 2024-07-12 21:41:34.

Hey all, I currently have a 10tb WB Red Pro (or plus?) drive which I use for the usual *arr, media, etc. I thought moving this off onto a home server in a sense would be nice. How does Synology work for this? Is it too opinionated, and does it allow direct access with a terminal, for stuff like containers?

Also looking at hosting some game servers and resource-intensive apps. Would a straight up home server with essentially a custom built desktop be the best choice?

view more: ‹ prev next ›