It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
5976
 
 
The original post: /r/datahoarder by /u/Vanguard3000 on 2024-10-06 19:17:18.

I have an art print from the early 90s I'd like to archive digitally. It's in colour and is printed on a magazine-like paper. The trouble is that the paper mainly has a matte finish, except there's a watermark-like pattern of the title on the background, in a glossy finish. Otherwise, the colour is the same, so you only see that pattern at certain angles or when moving the print.

I'm not sure if I'm explaining it ideally, but you are it sometimes on book covers and packaging, where most of the surface will be matte but the title, product label, etc, would be glossy. Usually, that's accompanied with a contrasting colour as well, but in this case the glossy pattern is the same colour.

I've scanned the image, and that watermark is basically invisible in most areas - I can see it very faintly in areas where I suspect the paper was warped away from the scanning platen, but it's not enough contrast to catch with Photoshop's magic wand tool to bump up the contrast manually.

Anyway, I've tried searching for ways of getting this to show a more prominently but I generally find ways of reducing paper textures instead (i.e. scanning a second time upside down, then overlaying), which seems to be the opposite of what I'm looking for.

Any tips would be appreciated. Thanks in advance!

5977
 
 
The original post: /r/datahoarder by /u/CorvusRidiculissimus on 2024-10-06 19:06:36.

I'm working on a new deduplication program. It's still experimental right now so I don't want to release it publicly, and it's currently linux-only. Though you can probably compile it for windows - the only part that might give you problems is the memory mapped IO. Anyone want to try it and evaluate?

It's a format-agnostic dedup. Short version is that it looks for files which share long stretches of data. It'll pick up things like multiple edits of one document, or multiple archives that all contain the same file (providing they use identical compression settings), or different versions of a file that differ in metadata but share the data in common. It'll scan a large collection of files, do some math, and return you a list of the ones that look similar.

Anyway, code.

https://pastebin.com/GNYGhZCf

This is barely-tested. It's probably full of memory leaks and such. It's a proof of concept. And yes, Rabin would speed it up a little, but I'm struggling to learn the math behind that.

5978
 
 
The original post: /r/datahoarder by /u/Wick3d68 on 2024-10-06 19:01:50.

Hi everyone,

I'm looking for a reliable and affordable cloud storage solution for my 1.2TB daily NAS backup (I search for 2TB plans). I've been using Infomaniak's kDrive but I'm hoping to find something even more budget-friendly.

My requirements:

  • Reliability: The service should be hosted by a reputable company with a strong track record of uptime and data security. I need a service hosted in a reputable location (e.g., not China or Russia) to ensure data security.
  • Protocol support: I'm using a Synology NAS, so I need a service that supports protocols like FTP, WebDAV, or S3 for easy data transfer.
  • Replication: While not strictly necessary, data replication would be a nice-to-have feature.
  • Cost-effective: I'm looking for a long-term solution, so pricing is a major factor.

I've considered these options:

  • Shadow Drive: $49.99/year with WebDAV support.
  • FileLu: $45/year but I'm hesitant due to limited reviews and potential bot activity.
  • Infomaniak kDrive: $71.88/year.

Additional notes:

  • I only need the cloud storage for backups and don't plan on accessing the data frequently.
  • I'm not interested in on-premise solutions like additional hard drives or NAS devices.

Can you recommend any other cloud storage services that might fit my needs?

Thanks in advance for your help!

5979
 
 
The original post: /r/datahoarder by /u/ElSqicky on 2024-10-06 18:04:57.

Hi! I want to get started with self-hosting, and I'm looking for a NAS. I’d like it to be somewhat compact and capable of running TrueNAS/OpenMediaVault. I’ve found two interesting devices, but I'm not sure which one, if any, I should choose:

Asustor AS6302T - used, around $150

TerraMaster F2-212 - new, around $140

I haven’t been able to find much information about them because one is quite old and the other doesn’t seem very popular. My main question is whether I would be able to set up an external SSD drive with TrueNAS/OpenMediaVault connected via USB and run the OS from this disk.

5980
 
 
The original post: /r/datahoarder by /u/TheUruz on 2024-10-06 17:22:43.

as the title say i'm new to the data hoarding world and need to setup a home NAS mainly used as a plex server but i might end up use it as a git server as well.

i ended up with something i belive is pretty classical but it should do for my needs, can an experienced hoarder tell me if i fucked up or it should be a good purchase?

it would be a Synology DS223J + 2 IronWolf 6TB (or 8TB still tbd) each. i'd like to have the first one backed up on the second so the total storage will be 8TB, i don't know ehich RAID it is but it will be that, i'll inform by the time i setup the whole thing.

my main concern is if any NAS specific hd can fit in any NAS or not, eg. could i put a 16TB hd in that NAS (if i had the money lol)?

thanks in advance :)

5981
 
 
The original post: /r/datahoarder by /u/LammasuRex on 2024-10-06 17:03:03.

Ideally, I'd like them in disk form and digital files. I think I saw an advertisement for such a service on Nostalgia Critic, but I can't find it.

5982
 
 
The original post: /r/datahoarder by /u/xolotl96 on 2024-10-06 16:34:15.

Hi, I am planning a NAS build and my motherboard has only 4 sata ports and I need 6.

Do you have any advice on SATA PCI cards? Everything I see on Amazon looks the same to me and I don't understand what I should be looking for to understand if one is better than the other. I just want something that will work in the long run and will not cause me problems.

Thank you in advance

5983
 
 
The original post: /r/datahoarder by /u/lostigresblancos on 2024-10-06 16:11:41.

EDIT:

THANKS SO MUCH to everyone who commented and helped me find out what happened. It sucks, but due to it being a cheap SD card that lies about capacity it overwrote the files when she mass imported them . Lesson learned, we will only be buying quality cards from now on.

Also, I think she bought the same ones for the kid's nintendo switches, better change those too.

Hi my wife moved her photos off her phone to an external SD card and I believe the headers all got corrupted. Cannot open any files on desktop or phone.

Ive been researching how to fix this for her, but i am concerned about downloading malware or getting scammed / hacked.

Options i have found:

  1. Manually replace the header with an EXIF tool : exiftool.org, XVI32 , HXD editor (probably not the best option for my skill level, would rather pay for a tool that actually works or a legit person whos not a scammer)
  2. https://www.anyrecover.com/photo-restoration/
  3. R-photo https://www.r-undelete.com/free_photo_recovery/
  4. Disk tuna https://www.disktuna.com/ (User https://www.reddit.com/user/seven-ooo-seven/ is banned?)
  5. Photorec https://www.cgsecurity.org
  6. Paid person to manually do the work : ie https://www.jpegmedic.com
  7. Stellar (lots of people saying this is a scam)
  8. https://repairit.wondershare.com/
  9. https://www.desertdatarecovery.com/
  10. https://www.easeus.com/video-repair-tips/repair-corrupted-jpeg-online.html

Please help me find a solution, this has really upset the wife as there were pictures of our kids and vacations that were affected.

5984
 
 
The original post: /r/datahoarder by /u/Mithlogie on 2024-10-06 15:45:05.

Hey all, historian/academic here, not so experienced with bulk downloading of materials on the web. Is it possible to bulk download the entire collection of document images in TIFF format from a digital collection like this at the LOC?

https://www.loc.gov/resource/mss19398.mss19398-066_0168_0925/?sp=2

I notice that the address string for each image just counts up (sp=2, sp=3, sp=4, etc.), is there some way I can use this in conjunction with some sort of web downloader software? It's embedded in an image viewer though, and the default file type in their image viewer is JPEG. You have to select TIFF from the dropdown in the lower left and click "Go' in order to get that file type. I'm guessing this causes issues when it comes to bulk downloading? Thanks for any help and let me know if I should post this elsewhere.

5985
 
 
The original post: /r/datahoarder by /u/trvrplk on 2024-10-06 15:23:07.

So, I've been trying to help someone find the title of some songs they got from the MySpace Dragon Hoard torrent, but I've hit a weird snag. They gave me the title of the mp3 file—std_bf3f8bc4a674411090b56a4389f87223.mp3—which is inside 113.zip. I can see from the list used for one of the Dragon Hoard search tools that the file is in its index, yet the metadata.tsv file and that project's SQL dump don't seem to have the metadata for this file. What I'm wondering and can't seem to get an answer for is if there were files in the Hoard that don't have corresponding metadata. It's also possible I'm just missing something here, since I'm not super familiar with this type of stuff—I'm teaching myself as I go.

Thanks!

5986
 
 
The original post: /r/datahoarder by /u/SaintTDI on 2024-10-06 14:20:21.

Hi all,

I bought a new WD Ultrastar DC HC560 20TB, it will be shipped next week :) I will install on my Windows PC, adding it on a StableBit Drivepool.

Are there some test that I have to perform before adding it on the Drivepool? Which software I should use?

Thanks in advance ;)

5987
 
 
The original post: /r/datahoarder by /u/TimeLordRohan on 2024-10-06 07:00:01.

I have a dvd that has a deep scratch on one particular place on the disc, but no other damage anywhere else on the disc. in both of my players and pc, it does not recognise that a disc has been placed in. is there any solution where i can force my pc to rip whatever remaining information off the disc?

5988
 
 
The original post: /r/datahoarder by /u/A5623 on 2024-10-06 06:03:46.

Title

5989
 
 
The original post: /r/datahoarder by /u/itchylol742 on 2024-10-06 01:25:00.
5990
 
 
The original post: /r/datahoarder by /u/Valuable-Speaker-312 on 2024-10-06 00:08:02.

Let's say that you don't want a home lab or anything associated with it - you just want to have a large amount of storage for Linux Distros - 240TB (raw) or more. If you had up to $5k to spend on your solution, what would you go with? NOTE: You can get something for under $5k if you use refurbished drives - 20TB drives can be gotten for ~$210 or so via GoHardDrive or ServerPartDeals when they are on sale (or for less) - so you can get it at that price point.

Out of the box Synology, QNAP, or build your own? If you build it on your own, what OS would you use for it? You CAN build something using a Jonsbro N5 case (12 drives) and then have a LSI 16i while using a 8087 to 8088 adapter so you can add a JBOD enclosure later.

Anyhow, tell me what you think you would do if you needed that type of storage space. I am genuinely curious as to what people would come up with. NAS, Windows Server, Linux server, or whatever.

5991
 
 
The original post: /r/datahoarder by /u/NateUrBoi on 2024-10-05 23:27:46.

Wasn't sure where else to post this, I figured this was the best subreddit for knowledge on storage devices. I'm looking to create a flash drive with many useful troubleshooting application installers and different operating system .iso files. This flash drive is ideally going to be on my keys or at the very least in my bag at all times so I need it to be physically durable and trustworthy. If this post doesn't belong here then just take it down. Thanks.

5992
 
 
The original post: /r/datahoarder by /u/Guilty_User_ on 2024-10-05 22:07:35.

Sorry if I'm not In the right fórum? I'm not a reddit person.

So I got the SD card online a time ago and I didn't use until a month or two ago?, it worked fine but after last week my devices haven't been able to read it, none of them . . . And I had a lot of important things on it, I'm not sure what to do with it or how to get photos back.

Not just that but I have decided to take to. Time to learn about SD cards so I don't make the same mistake again, After some videos and reading a lot I saw some comments about how some SD cards don't always work or work just for some time, and some cheap ones are bad?. someone online mentioned something about getting a laptops and a SD card reader to see if that way I can get my things back.

Btw does anyone know how can I get this SD card to be read and then get my things back?, and what are your recommendations for a new SD card, brands, types, prices?, and any recommendations to keep my documents/ photos saved?, UBS?, SD, cards? I heard about the cloud but not sure how to make it work.

Please don't kill me, I never had the need to use a SD or anything similar before, and I just need my old photos back

5993
 
 
The original post: /r/datahoarder by /u/MaximusConfusius on 2024-10-05 21:31:29.

I was just looking for a HDD upgrade for my homelab. I remembered last two times I bought 4TB Ironwolf for around 100€ each. I expected 6TB to be around that price level nowadays, but then I couldn't believe my eyes. Still 100€ for 4TB???

I had a look in my emails and found this:

01.09.2022|ST4000VN008|95,49€

21.03.2023|ST4000VN006|83,95€

05.10.2024|ST4000VN006|93,74€

What the fuck is going on here? That's +11,6% in half a year! Do you think we should hoard some drives for resale instead of data?

5994
 
 
The original post: /r/datahoarder by /u/Jeep-Eep on 2024-10-05 19:37:50.

Call me vain, but I'm getting into hardcore data hording and would like to see if something would look... modern... in my window'd case.

5995
 
 
The original post: /r/datahoarder by /u/NightmareCliff on 2024-10-05 18:31:21.

Hello! I have been saving to try and get into organizing a crap ton of data I have in 2 USB keys and my main computer so I can have everything in one area, and free up my computer so it is not too cluttered. I recently found out DVDs can be used as a storage medium, though not most ideal as you need tons of them due to low storage capacity. But, supposedly, or allegedly, gold-layered ones can last for up to 50 years, theoretically 1 to 2 centuries (there seems to be debate about this).

Moreover, the total cost of getting an external optical drive, and multiple DVDs so I can have backups too, seems to be a bit cheaper than the cost of getting numerous high quality external 1TB HDDs as I do not want anything cheap and risk losing all the data. I intend to get 1 external HDD as main, 1 as backup, and maybe a third as backup backup.

Of course, for HDDs I also need static bags, and potential containers, to keep them safe. For DVDs. there are packs of 100 cases, though quite pricey, so honestly the cost might end up being similar in total. Although, static bags seem to come in large packs, so I do not know what I will do with the remainder once I use up 2 or 3. Anyways, HDDs also don't have the largest life span, but pretty decent at like I think 15 or 20 or so years?

And obviously, I know that regardless of medium, you should always check on your data to make sure it didn't die, and potentially doing updates as necessary.

TL;DR then, I just want to know what would be best for the situation of ~700 GB of data: DVD discs or HDDs. I also not gonna lie, I kinda like the idea of DVDs cuz I can eventually make a shelf in my house, but I can imagine transporting a box of them will be the most painful endeavor as I am a person who moves around international borders quite a bit. A big reason on why I am also hesitant to invest in this, because for all I know, my data might end up seized by a border officer at some point, so maybe I should just setup a data center hidden away in a mountain in a forest lol.

EDIT: By gold-layered i mean "archival grade", which kinda sounds like marketing jargon.

5996
 
 
The original post: /r/datahoarder by /u/DallMit on 2024-10-05 13:38:35.

Hello. I am not the author of this software. I didn't even download it yet. I just found it and noticed that nobody on this subreddit mentioned it yet.

Here is the link to the github page of this project:

https://github.com/TagStudioDev/TagStudio

Here is the link to the video where the author explains how he wants it to work, his goals and the alternatives he found:

https://www.youtube.com/watch?v=wTQeMkYRMcw (there is also a second part of this, after he actually made the software public)

He has a nice voice (yes) and it seems like he just wants to make the best program possible that is useful for many different use cases.

By making this post I hope you will get inspired and go contribute to the project, maybe make some suggestions. It seems it will be a great one when its finished.

And I will come a few years later and enjoy it when its actually complete.

(Mods, if this breaks rule 6, thats like just your opinion man!!! Its open source!)

5997
 
 
The original post: /r/datahoarder by /u/Glittering-Skirt-816 on 2024-10-05 10:16:34.

Hello everyone,

I'm new to the world of new build NAS and I'm looking for advice for a personal project. At work, we use Synology NAS as well as OVH and Amazon servers, but on my side, I have an old PC converted into a NAS.

Software-wise, I know what I want to do: install Proxmox to manage virtual machines (VMs) and containers. My main goal is to set up a NAS to share a storage space (Drive type) with my friends.

I've got a budget of around €1,000** and I'm looking for a solution that's both energy-efficient and capable of handling RAID 5 or even RAID 6.

Where I'm a bit lost is on the hardware side:

  • Which case to choose?
  • Which CPU and motherboard to choose?
  • What power supply is recommended for this type of configuration?
  • Are there any ready-made solutions, or is it better to assemble everything yourself?

If you have any ideas, feedback or recommendations, I'd love to hear from you!

Thanks in advance for your advice!

5998
 
 
The original post: /r/datahoarder by /u/Veterandy on 2024-10-05 10:12:33.

I am very sorry if this question has been asked already, but is there a Megathread or a list of online Archives? For example old Games, Movies, Memes, ect.

Thank you all very much!

5999
 
 
The original post: /r/datahoarder by /u/CascadianCrabs on 2024-10-05 05:38:13.

Original Title: Wanting to have a physical copy of Dune 2, looking at this blu ray copy. the backside is talking about a code and download, is there no physical copy in this/do I need an internet connection to play??

6000
 
 
The original post: /r/datahoarder by /u/neocamel on 2024-10-05 04:30:45.

So I've been paying Backblaze to keep a backup of my HDD that stores all my important data. I recently switched my main OS to Linux, which is not supported by the consumer Backblaze product.

It got me thinking about how I could set up an off-site backup myself.

My idea is to set up a second HDD at my parents house, connected to their router via ethernet cable. I'm hoping there's a good way to configure my network drive with some kind of cron job that would mirror the contents of my network drive to the drive I'd set up at my parents house. That way if my house burned down or I got burgled, I'd still have an off-side duplicate of my lost HDD.

Is this a good idea? Are there considerations or pitfalls I should be aware of with a setup like this that might make me think twice? If it's a decent idea, I'd appreciate being pointed in the right direction as far as where to begin building a setup like this. Thanks!

view more: ‹ prev next ›