It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
9851
 
 
The original post: /r/datahoarder by /u/AnarkyGotham on 2024-05-17 07:20:16.

Hello, i currently have a Macbook but i rarely if not never use it much besides using it to connect an SDD/HDD monthly to transfers photos/videos and such. So i’m thinking of selling it and getting an iPad but i wonder if i would be able to datahoarder, connect an SSD/HDD and such with just an iPad or should keep the just keep Macbook and not get an iPad and overall for longtivity and such?

9852
 
 
The original post: /r/datahoarder by /u/fillilutten on 2024-05-17 07:18:01.

MergerFS is set to default existing path - most free space.

I have 3 disks in this mergerfs pool where one disk is full. I ran into a problem when sonarr tried to import a new season to a show that is already on the full disk. I would like to keep a whole show on the same drive but I of course don't care to have different shows on different drives. I solved it by manually moving the whole show to the /tv folder on a drive with free space. But are there any solution to automate this?

Thanks!

9853
 
 
The original post: /r/datahoarder by /u/Few_Landscape_573 on 2024-05-17 06:01:24.

Do you guys know any good ones that don’t log users info?

I’m worried about security data breaches about my personal info.

9854
 
 
The original post: /r/datahoarder by /u/VibWhore on 2024-05-17 05:19:06.

So there's this educational institution which has provided me with a number of video lectures in a special format that can only be accessed throught an application called "Player" by HSC-PK available on Microsoft Store.

I have those videos downloaded on my device but they are in a special format, which can only be accessed through the "Player" by entering the credentials in it.

Is there anyway that I can figure out to convert those files into a normal .MP4 format through which I can open it and use it normally?

9855
 
 
The original post: /r/datahoarder by /u/ThyRhubarb on 2024-05-17 03:29:18.

I avoid Western brands especially Samsung which are the mostly fakes ones (really what's with all those 1080 pros). Got a $80 crucial p3 plus 2tb, $35 1 tb Fanxiang s660 off a pricing glitch from Temu. Apart from delayed shipping ($5 credit for me lol) product confirmed to be real with testing and device id. The Fanxiang got slightly faster read but slower write than the Crucial about 2.4 vs 2.8GB/s seq write 1GB (in a asm246X usb4 enclosure). Crucial one runs way hotter though while the Fanxiang stays cool even under load. 2x benchmark followed by 5 min SSD cloning from 200GB

9856
 
 
The original post: /r/datahoarder by /u/SantiNico23 on 2024-05-17 02:45:43.

i cant find these two videos:

https://www.youtube.com/watch?v=_qfmfP81oSw

https://www.youtube.com/watch?v=iMSjhOALs64

i tried using web archive but nothing, can anyone help me? Thanks!

9857
 
 
The original post: /r/datahoarder by /u/newtoaster on 2024-05-17 02:02:54.

So we are selling the house and moving into an RV to travel full time. My PLEX server is a mac mini that currently has a 4 drive external enclosure that runs crazy hot and has a fan that sounds like a leaf blower. Power is at a premium off grid, so I want to replace it with something solid state. I need more than 4TB (6 would do). Whats my cheapest option at the moment for something thats not trash?

9858
 
 
The original post: /r/datahoarder by /u/fakeshaf on 2024-05-16 21:36:20.

I'm trying to find a deleted youtube video. I tried using wayback machine, but it says it failed because the account associated with the video has been terminated. Does anyone know what to do?

9859
 
 
The original post: /r/datahoarder by /u/noshirtnoshoesnsfw on 2024-05-16 21:11:45.

Just wondering if there's someone out there who has a log of the live-only highway traffic cams around Phoenix AZ, there's an event from a highway accident about a month ago that I'm looking into.

If you log those or know someone/a group that might, id appreciate it!

9860
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/shinji257 on 2023-09-26 16:14:06+00:00.

9861
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/dnabre on 2023-09-26 14:58:46+00:00.


My workflow would really benefit from moving one of my VM's with its torrent/download working data from HDD to SSD. This is where unsorted/verify data is slowly being pulling into my network. Data sits around for a week or two before being deleted or moved to long-term big HDD storage. Checksums, deduplication, checking signatures is the main job here.

Having the VM (like 30GB) plus 2-4 TB of working space run at low-tier SSD speed instead of low-tier HDD speeds would really help. It's transitory storage and only maybe 500gb/day writes and data loss would be more an inconvenience than anything. Looking for around 2-6TB of available storage with at most a single device worth of redundancy, 2.5 inch SATA interface, overall budget is may $100-250 at most.

Lots of 'cheap' or 'generic' brand drives out there (looking at newegg): Silicon Power, KingSpec, Team Group, etc. With minimal needs are this brands decent. I could never grok the different types of SSD (MLC, TLC, QLC), what would people recommend.

Any recommends would be appreciated.

9862
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/gerdemb on 2023-09-26 14:19:13+00:00.


r/DataHorder community,

I've been working on a Mac app that continuously backs up the entire photo library, including iCloud Photos, to any destination (like local drives, network mounts, NAS, etc.) while maintaining the original quality of the photos and videos. Can you give me some feedback about the features necessary for such an app? Here is the current version you can download and play with for free:

9863
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/88slides on 2023-09-26 14:16:31+00:00.


I've been digitizing some family tapes and recently noticed some distracting noise in the form of diagonal lines across the sky in landscape shots.

The noise turned out to be from a mismatched ground - my camera was getting power from a USB adapter plugged into my computer, but my upscaler was referencing ground from another outlet. Plugging the camera into a USB wall wart on the same outlet solved the trouble.

I did some searching around for what might be causing that kind of noise but ended up having some trouble, so I figured I'd make a demo of what it looked like and what solved it.

For anyone curious, the setup I'm using: Sony CCD-TRV815 -> S-video -> generic Amazon USB capture card. It's certainly not a proper master backup, but I don't have a TBC or know much about deinterlacing so it seems fine enough.

9864
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/ianlola on 2023-09-26 12:34:52+00:00.


I have Synology 2-disk NAS where I back up all my photos, as redundancy - I am looking for a cold storage off site (aka that would mean online provider) as a safe backup to never lose the photoes

Currently have ~200 GB and growing quickly.

I checked B2 with 1TB would cost $60 a year.

  • Is B2 an appropriate choice?
  • Should I look into going from Synology directly to AWS S3 Glacier instead?
  • Is there better option?
9865
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/LordOthello on 2023-09-26 11:32:58+00:00.


Hi folks,

I am looking for suggestions / recommendations on backup programs which have all of the following features.

The situation is simple – lots of different devices (phones, laptops, one desktop, and a chromebook) all accessing and writing to a common fileshare (windows home server). This server needs to be backed up to (1) an external drive / DAS and (2) Google Drive.

I have searched on here as well as other places online, but can’t seem to find a backup software that explicitly mentions all of the below points in its feature-set.

Hoping folks here can help. Thanks!

  1. Reliable, reliable, reliable – proven reliability over multiple years (scared of all the horror stories that people here have shared about Duplicati, for example)
  2. Should have a GUI (can’t be command line only)
  3. Block-level differentials, byte-for-byte checks, incremental backups…usual stuff
  4. Real-time, periodic and manual backups
  5. Integrity Check – this one is the one I am having most trouble with. I am looking for software that is able to (a) verify the backup files against source files, and (b) verify backup files against older versions of itself. Basically some sort of protection against ‘bitrot’.
  6. Some form of ransomware protection? Encryption? (Hence, afraid of using sync software for backups).
  7. The app should not be abandonware (I don’t mind if its paid/ closed source)
  8. Set and forget with minimal manual intervention
  9. Good to have - Cross-platform. Should be able to read/ restore backup data from variety of different OS environments.

I have looked at some sync / backup solutions such as syncthing, freefilesync, bvckup2, and a few others which are often mentioned here.

I have also looked at some image backup solutions – Macrium and Terabyte Image for Windows.

Also, not looking for ZFS as a filesystem for the bitrot part, this is a windows server with NTFS and different sized drives pooled with Stablebit Drivepool.

So far, the 3 solutions that looked most promising to me (but all 3 are Windows only sadly)–

  1. Bvckup 2 – Best part about it is there is no vendor lock-in, as files are just copied over without any proprietary format.
  2. Terabyte Image for Windows – has almost all the features, but don’t know about the bitrot part. Also proprietary backup image format
  3. Syncback Pro – This also seems to have most of the features but I don’t know

So what I am thinking –

Use some sync software (syncthing, resilio sync, etc.) between the server and all the different devices. And use one of the above 3 backup solutions to backup the server to the external HDD and cloud.

Open to suggestions. What do y’all use yourselves?

Many thanks!!

9866
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/milefork on 2023-09-26 10:21:22+00:00.


Hi all,

recently I purchased a HP 1/8 G2 Autoloader with a LTO3 PD003-20103 Drive.

The drive turns out wasn't or isn't working. So I opened everything and started inspecting with lids open and trying to load a tape. The load mechanism was not moving and at some point I figured out that the little arm which will catch the lead stick(is it called that?) of the tape was bend. So I corrected everything and moved the mechanism manually. It seems to work now.

Sadly in the process I've broken the switch which will I guess check the Tapes Write Protection status and also if a tape is present at some movement states. The switch has a long "button" to get in touch with the tape which broke off.

So to my question, does someone of you has a tape drive like this and can measure in the switch so that I can try to find or build a suitable replacement for it? Thanks!

Here a some photos.

Switch in question

"Emtpy" Switch case

9867
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/samuelncui on 2023-09-26 11:07:02+00:00.


Considering the market's lack of open-source tape management systems, I have slowly developed one since August 2022. I spend lots of time on it and want to benefit more people than myself. So, if you like it, please give me a star and pull requests! Here is a description of the tape manager:

YATM is a first-of-its-kind open-source tape manager for LTO tape via LTFS tape format. It performs the following features:

Processing img wi08f8wz1lqb1...

screenshot-jobs

  • Depends on LTFS, an open format for LTO tapes. You don't need to be bundled into a private tape format anymore!
  • A frontend manager, based on GRPC, React, and Chonky file browser. It contains a file manager, a backup job creator, a restore job creator, a tape manager, and a job manager.
    • The file manager allows you to organize your files in a virtual file system after backup. Decouples file positions on tapes with file positions in the virtual file system.
    • The job manager allows you to select which tape drive to use and tells you which tape is needed while executing a restore job.
  • Fast copy with file pointer preload, uses ACP. Optimized for linear devices like LTO tapes.
  • Sorted copy order depends on file position on tapes to avoid tape shoe-shining.
  • Hardware envelope encryption for every tape (not properly implemented now, will improve as next step).
9868
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/dom_bul on 2023-09-26 10:54:04+00:00.

9869
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Aswe14 on 2023-09-26 10:46:26+00:00.


Hello fellow hoarders,

I have a Terramaster NAS set up but I’m wondering if anyone can do me a solid and send me a website or something as a step by step guide to gaining access to my NAS outwith my home wifi network. Any thoughts? The model I have is F5-221.

Thanks in advance team!

9870
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/No-Explanation2174 on 2023-09-26 10:25:59+00:00.


Hey guys. I am in desperate need for more sata ports as nearly all 6 of my motherboard ports are in use.

My current setup is 4 hard drives (2 of which in use 24/7 and other 2 written to daily) and a dvd player (used very occasionally).

I plan to add more drives in the future so thats why ive been looking into solutions for my sata port shortage.

My first option would be to sacrifice my pcie gen 3 x16 slot for a card with alot of sata ports (say 12/16). My second option would be to use a sata port splitter (example: )

The problem with the pcie card is that the slot is disabled due to me using an m.2 slot. I could move my ssd to another slot but that would disable 2 of my 6 sata ports on my mobo

I want to avoid bottlenecks so im aiming for each hard drive having 250MBps to read/write. with the port splitter option id be able to use 3 ports before i start potentially bottlenecking my drives.

What would you guys recommend? all help is appreciated :D

Note: i have both the physical space and power cables to house many more drives. The issue really only are sata ports

9871
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/pawpbawb on 2023-09-26 09:07:50+00:00.

9872
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/MinhajBEHz on 2023-09-26 07:17:46+00:00.


Hi, I'm trying to migrate my OS from my C drive which is on a Kingston SSD to my new Samsung SSD, now Samsung does have data migration tool. I wanted to ask, what would be the right way to approach this, I have a HDD connected that isn't critically necessary and I can use that SATA port to connect my Samsung SSD for migration (all my SATA ports are occupied, that's why), is there anything specific I need to do or anything I need to prepare except for backups? I'm currently a student and can not sustain any financial damage right now so I wanna do things right.

Thanks in advance.

9873
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/zytoxico on 2023-09-26 07:05:41+00:00.


Say I've got 10 gb/s transfer speed on my USB hub and 10 gb/s read/write speed on the drive, is it then capped on that speed or does it cap earlier than that?

I was thinking about getting an external ssd + hdd for my laptop's measly 1 TB :P, but after learning about the existence of external cases for ssd/hdd's, that seems like that'd be better or am I mistaken?

Just wanna to understand how to get an optimal external drive setup + transfer speed for both external gaming + 4k media of larger sizes up to 50 gb (or 300 gb too cuz I recently learned how bulky skyrim modpacks are xD.) that I can use on my laptop and even desktop.

I googling around and 10 gb/s was the easiest to get transfer speed aside from expensive 40 gb/s thunderbolt hubs. (My laptop does have those hubs)

9874
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/jeruthemaster on 2023-09-26 07:04:25+00:00.


There’s only one app that can (as far as I know) but it only goes as far back as 3 months, then it stops working. There’s a lot in there that I wanna go through, but it’s impossible to do within chrome. Ideally, I’d like to extract all 27,000+ history (tabs?) and put them in a Excel Spreadsheet and narrow down from there.

9875
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/edrow_30 on 2023-09-26 06:10:26+00:00.


Just got a seagate 8tb hdd that's in a usb 3 enclosure, plugged into USB 3 port. Ubuntu recognizes the device as a USB 3 device.

When I started the format, it was 1 day 10 hours (high 60 mb/s). About a hour later, 4 days (20mb/s). 20 mins later, 4 months. 1 hour later, back down to 3 to 4 days.

Tried it on another pc...same thing.

Am I dealing with a bad drive or something in ubuntu (22.04) that needs to be tweaked?

view more: ‹ prev next ›