It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
4476
 
 
The original post: /r/datahoarder by /u/TheSwedeLander on 2025-01-19 16:15:36.

I am attempting to convert a number of family VHS tapes to digital. I am using VirtualDub2, and so far it has worked largely without issue. Recently I've started to notice an issue where the video starts stuttering (not sure if that's the best word) during capture and it makes the resulting video file almost unusable. I was hoping to get some advice on what might be causing the problem and how to fix it.

I first noticed this issue with longer clips. It looks almost like the video capture is losing frames, but VirtualDub isn't reporting any lost frames. In the resulting file, it causes the audio to desync and the end of the video file sometimes has a freeze frame of whatever the last video frame was while the audio finishes playing. As I mentioned, this seems to be more prominent in longer clips, but it has started becoming an issue in shorter clips now as well. The strangest thing is that as soon as I stop the capture, the video feed returns to normal and it looks perfect. I think it is a software issue because of this. To reiterate, the problem is noticeable while I am capturing video and the issue is present in the resulting file, but as soon as I stop the capture, the feed in VirtualDub appears to be normal.

Has anyone experienced similar or have any suggestions on how to fix the problem?

4477
 
 
The original post: /r/datahoarder by /u/Electr0Fi on 2025-01-19 15:16:19.

Hi Reddit,

I need some advice on expanding my current TrueNAS setup.

My case has room for 8 (+1) x 3.5" HDDs and as such my current Zpool consists of 8 x 6TB HDDs in a 4 vdev, 2-Way Mirror which equates to about 22 TB of usable space.

On my Zpool I have approximately a 20 TB Plex Library, 1 TB of Photos, 500 GB of Audio and 500 GB of Miscelaneous Backups (Documents, etc). The Photos, Audio and Documents are backed up on a seperate "Backup" NAS. The Plex Library is not backed up.

The reconfiguration/expansion options I'm currenly looking at, by purchasing 18TB HDDs are:

⦁ Purchase 2 new HDDs: Upgrade 1 existing, 2-Way Mirror vdev from 6 TB to 18TB drives [2 x 18 TB = 18 TB]

⦁ Purchase 3 new HDDs: Create a new 1 vdev, 3-Wide Z1 [3 x 18 TB = 32 TB]

⦁ Purchase 4 new HDDs: Upgrade 2 existing, 2-Way Mirror vdev from 6 TB to 18TB drives [4 x 18 TB = 32 TB]

⦁ Purchase 6 new HDDs: Create a new 2 vdev, 3-Wide Z1 OR 1 vdev, 6-Wide Z2 [6 x 18 TB = 65 TB]

I would say that my server sits idle for about 90% of the time. The only time it's really active is when streaming Plex or my other computers or phone pushes incremental backups to it. As such, I would guess that bandwidth is more important than IOPs, especially since I don't run any VMs on it.

If I switch to a RAIDZ setup, I would probably just use that for my Plex library, and keep my other data (Photos, Audio, Documents) on a 2-Way Mirror. While it would be a ball-ache if I lost a second drive during a resilver operation on a RAIDZ, and subsequently my entire Plex libary, at least most if not all of it could be "recovered", over the course of a few weeks/months.

I'm just a little confused about what I should prioritise (storage space, redundancy, bandwidth, resilver speed, flexability), and I keep reading about RAIDZ1 not being recommended for "large or > 1 TB" drives, and that people should be happy enough with Mirrors not use RAIDZ.

Any comments or recommendations?

4478
 
 
The original post: /r/datahoarder by /u/adyx16 on 2025-01-19 13:42:52.

Hello people. So I'm new into the NAS thing. I decided that I want to buy one with the main purpose of archiving all my files (movies, clips, photos, gifs etc.) so I don't need to think about them every time I change my computer or whatever and to be able to view those files while at my pc (I'm thinking something like plex - did not really look into how all that works but was hoping to open plex on my pc and watch whatever files are on my NAS). That would be the main purpose of the NAS and I will be the only user. With all that in mind I came up with a list of stuff to purchase and I would appreciate if someone more experienced in this filed could tell me if my list looks good, if it's too little (I doubt it), if it's overkill or if I should change anything or whatever:

  • AS5404T
  • Lexar DDR4 SDRAM LD4AS008G-B3200GSST 2x8GB
  • WD Red SN700 SSD WDS200T1R0C 2TB M.2 PCI Express 3.0 x4 (thinking only 1 of these for NAS OS and cache? )
  • WD Red Plus (CMR) - 4TB - Harddisk - WD40EFPX - SATA-600 - 3.5" 4 of these
  • APC BX750MI-GR - Back-UPS - 750VA/410W

I read some stuff about the WD red HDD that after 3 years you'll get some warning, there was some drama about that a couple of years ago but not sure if relevant or if it was just on synology systems or if it was resolved since.

Also do I need to worry about the compatibility list from asustor's page? Will I have issues if the HDD or SSD are not on that list?

Thanks.

4479
 
 
The original post: /r/datahoarder by /u/steviefaux on 2025-01-19 12:11:53.

So my partner loves Apple, I hate them so despite being a tech I very rarely touch anything Apple.

She has her old original ipod from before we got together, been 10 years this year and all that time its just sat in a draw.

It still works but how would we get the data off it as it being Apple they love to make it as difficult as possible.

4480
 
 
The original post: /r/datahoarder by /u/Fancy_mantis_4371 on 2025-01-19 10:56:17.
4481
 
 
The original post: /r/datahoarder by /u/Kingslord25 on 2025-01-19 10:49:56.

Just wanna give a shoutout to nopperl, who has created an extension for Firefox which automatically loads images directly instead of their HTML page and gives you the ability to change the accept header, so your browser doesn't load webp over png/jpeg. Thanks to that, you can download images directly from Reddit as pngs and jpegs without the need to convert these files afterward.

Github: https://github.com/nopperl/load-reddit-images-directly

Firefox addons: https://addons.mozilla.org/en-US/firefox/addon/load-reddit-images-directly/

4482
 
 
The original post: /r/datahoarder by /u/VirtualEffort8 on 2025-01-19 09:42:45.

Would a hard drive be enough?

Not too sure if I can embed a video here, but link below:

https://www.tiktok.com/@jesseo8/video/7461433189848845599

4483
 
 
The original post: /r/datahoarder by /u/kepkep2 on 2025-01-19 09:33:29.

Hey all, I'm in the process of moving all my torrents from a web seedbox to a self hosted solution now that I have a fast connection. What's an easy and low effort solution for a person that's tech literate but not really used to linux? I have a rasperry pi but also access to some older PCs with Windows, 3 hard drives for a total of around 35 TBs and a few 500 GBs SSDs.

4484
 
 
The original post: /r/datahoarder by /u/Spoolios on 2025-01-19 09:31:16.

https://reddit.com/link/1i4uuvj/video/w7ge65qy5xde1/player

This is my first RAID and for cost reasons, it's HHD.

I can't figure out if its supposed to be this loud or if it arrived broken?

In the video I:

-Power Up

-Transfer Media (:28)

-Run DriveDx (1:10)

-Eject (3:27)

-Power Down (3:46)

It sounds awful when I run DriveDx. DriveDx is also showing it as a RAID1, when I have it formatted to RAID 0, hence the 48TB available.

Does this all seem normal? Or should I be looking to replace it before I begin acquiring tons of media?

4485
 
 
The original post: /r/datahoarder by /u/CabralAlb88 on 2025-01-19 00:05:12.

I currently own 2 2TB HDDs that I usually use to store a lot of photos/movies/anime. It's data that I don't use every day but I need it at hand.

The problem is the noise they make. My PC is dead silent and these 2 keep bzzz ZZZ pzzz zppp wzzzzz whenever they feel like.

Is there any way I can keep them connected to my PC but turn them on/off whenever I want? An external rack maybe? Sure I would love to have them connected to my PC via SATA but USB could work too.

4486
 
 
The original post: /r/datahoarder by /u/Specific-Judgment410 on 2025-01-18 22:24:18.

I need to backup about 8-10TB worth of files, BackBlaze is apparently unlimited (which I find hard to believe) but willing to try it out. Does it allow archiving of files (cleaning up old/deleted files on command?).

Occassionally I swap/move things around in my backups and want automated cleanup with a list of everything that will be deleted upon my command. If they allow script cleanup that would be nice too.

Appreciate any suggestions.

4487
 
 
The original post: /r/datahoarder by /u/Alternative_Leg_3111 on 2025-01-18 20:34:19.

I've got a linux machine I need to reinstall the OS on, and it has two drives in RAID 0. What's the best way to reinstall the OS without losing my data? I unfortantely don't have 12TB spare to copy it to in the meantime.

4488
 
 
The original post: /r/datahoarder by /u/Good-Lifeguard5243 on 2025-01-18 19:47:29.

Hello everyone,

First time posting here so if my post is not relevant feel free to remove it!

I recently bought a Mac Mini M4 as my main computer. I’ve been using a 4TB hard drive for data storage for several years. Since I’ve always used Windows in the past, the hard drive is formatted in NTFS, which prevents me from writing or making changes to it on my Mac Mini.

Do you guys have any advice on how I can transfer or write files to the hard drive while keeping its current format (without reformatting it to FAT for macOS)?

Thank you!

4489
 
 
The original post: /r/datahoarder by /u/Professional_Tip2911 on 2025-01-18 17:55:56.

I have a G-Raid drive that I used on my Dell Laptop running Windows 11. I recently had to work on a project on a Mac so I ended up reformatting the drive and was able to use it on Mac. Now, I can't get it to work again on the Dell. I've tried formatted exFat and NFTS, but it doesn't show up in Windows anymore. It's not in my drive and doesn't show up in Disk Management. I know the power and thunderbolt cable work because it still recognizes on the Mac. Every fix I've read online involves Disk Management, but what do I do if it's not showing up there?

4490
 
 
The original post: /r/datahoarder by /u/ontic00 on 2025-01-18 16:51:44.

TL;DR SingleFile saves more accurate Reddit content than Save Page WE, with Save Page WE not accurately displaying comments, buttons, or search bars. Why could this be? File sizes are also difference for Reddit content (~125MB for SingleFile, ~10MB for Save Page WE).

I've been a long-time user of Save Page WE (a browser extension to save a single-file HTML using Data URIs) and was recently trying to see how many of my extensions I could use on Android. I noticed an alternative extension, SingleFile, is supported on both FireFox and Kiwi, versus Save Page WE is supported only on Kiwi. That and in addition to seeing it's been a while since Save Page WE was updated (late 2023), I decided to do a more extensive comparison between Save Page WE and SingleFile. I noticed for the most part, they produced fairly identical looking pages with similar sizes. The one exception I found was Reddit - SingleFile was way more accurate with saving threads, and also had a lot larger files (100-150MB vs ~10MB for Save Page WE). The comments weren't clearly visible in Save Page WE without inspecting, and the buttons and search bars looked different.

Since the file size was smaller, I'm assuming it's not saving some sort of resource. I had it show the list of unsaved resources and they were:

https://accounts.google.com/gsi/style

https://emoji.redditmedia.com/p9sxc1zh1guz_t5_3nqvj/cat_blep

https://accounts.google.com/gsi/client

https://www.google.com/recaptcha/enterprise.js?render=6LfirrMoAAAAAHZOipvza4kpp_VtTwLNuXVwURNQ

I'm an amateur when it comes to web-archiving, mostly just using Save Page WE and Fireshot to save important webpages, so I was wondering if anyone who knew more about HTML and archiving would have any idea why SingleFile would save Reddit content so much better than Save Page WE. Could it be related to one of Save Page WE's unsaved resources above, or are there other possible explanations? I think I'm on the verge of switching to SingleFile due to its more frequent updates, customizable infobar, and it seeming to save at least Reddit content better and possibly other things I haven't run into yet. Thank you for any knowledge!

4491
 
 
The original post: /r/datahoarder by /u/sleeping_sunflower on 2025-01-18 15:02:04.

Hi all, with the TikTok ban, I wanted to know is there a way to mass download TikTok slideshows and/or photos? I have used myfaveTT which works great but it doesn't download slideshows. Has anyone had any success with any apps or extensions? FYI I'm using Appple products.

Thank you in advance!

4492
 
 
The original post: /r/datahoarder by /u/stilljustacatinacage on 2025-01-19 05:02:35.

I've been at this for a while and I feel like I'm no closer to an answer, so I'm beginning to think that what I want may not exist (at least, not within my price category).

The closest thing to what I want is something like the ASRock Industrial ITX boards that come with BGA Pentium / Celeron chips. The problem is, these all seemingly come with a PCIE x1 (bad) or x16 slot (good!), running at x1 speeds (bad.) and that's not suitable for slotting in an HBA card.

I'd like something in a traditional-ish form factor, since the idea is to fit it into a regular case that can hold up to 8 3.5" drives. Still, I was looking at the Zimaboard but it has a x4 size PCIe slot and I need at least x8. I don't feel like faffing around with risers or adapters.

Right now, it looks like my best bet will be to source some old mobo/CPU combo from Ebay or Aliexpress, but I was really hoping to at least get a chip from this decade. Most of those are running 3rd or 4th generation Intel Core stuff.

I just thought I'd ask before I changed directions or adjusted the budget, etc. Just to reiterate, what I'd like to find is:

  • Traditional form factor (mATX, ITX)
  • x8 or x16 PCIe slot (running at least PCIe gen 1 x8)
  • Relatively cheap, used is OK, ~<$150 USD

Any leads would be appreciated. Worst case I'll probably just go the Aliexpress route, but I thought I'd see what's out there.

Thanks!

4493
 
 
The original post: /r/datahoarder by /u/nii_tan on 2025-01-19 04:47:19.

https://preview.redd.it/j8biocdorvde1.png?width=1695&format=png&auto=webp&s=db677c4a7f450435fc575b3fa5d3327acbcfcbfd

some games have been throwing errors like Black Desert, then I reinstalled on the mx500 with a complete wipe of the game, then I installed it on my m.2 drive and works perfectly without corruption. Is this drive failing or could it be a cable?

4090

7800x30

b650e pg riptide

4494
 
 
The original post: /r/datahoarder by /u/dp3471 on 2025-01-19 04:37:49.

First, I understand r/techsuport exists, just keep reading.

Here's the situation:

  • Bought 2x10TB sas drives + lsi-9361-8i card for $110 for data storage, and a mini sas + sata power -> sas drive breakout x4 cable (+ tiny fan to cool the cheap heatsink)

  • plugged in 1 drive (to test out with Windows) at first. Showed up without me setting up anything, so I thought, might as well partition it, since everything seems to be plug-and-play right?

  • partitioned the drive to 100% capacity in Windows.

  • Installed storcli (from here after a couple attempts at super old versions and mismatching protocols) to check on the card, and plugged in 2nd drive to attempt to create a ~18 tb raid0. Whenever I tried to do anything to that drive, it freaked out and disconnected. Want to delete the virtual drive (which was automatically set up[??])? too bad, disconnect. Want to reset the drive's configuration? too bad, disconnect. Every disconnect required me to power cycle to get the drive to show up again.

  • Bios configuration did not help at all and I was absolutely stumped, so I flashed the card, and still no progress.

  • Today, I tried to wipe first and last GB of each drive with zeroes, factory reset card with drives plugged out, and still no hope

  • Tried using storcli's sanitize on the bad drive, which didn't work. Then, I tested it on the good drive. It works, but now I CAN'T STOP THE SANITIZATION!! No warning about this.

Honestly, this is driving me nuts. I understand I made a foolish assumption, but I feel like there is a level of firmware/software communication incompetence I can (am) blame.

Here are some more technical details [some things omitted for de-cluttering]:

CLI Version = 007.2309.0000.0000 Sep 16, 2022
Controller = 0
Model = AVAGO MegaRAID SAS 9361-8i
Serial Number = SK74377539
Current Controller Date/Time = 01/19/2025, 04:28:28
Current System Date/time = 01/18/2025, 23:28:28
SAS Address = 500605b00d860410
PCI Address = 00:03:00:00
Mfg Date = 10/27/17
Rework Date = 00/00/00
Revision No = 14C
Firmware Package Build = 24.21.0-0159
Firmware Version = 4.680.00-8577
CPLD Version = 26515-01A
Bios Version = 6.36.00.3_4.19.08.00_0x06180206
HII Version = 03.25.05.15
Ctrl-R Version = 5.19-0609
Preboot CLI Version = 01.07-05:#%0000
NVDATA Version = 3.1705.00-0028
Boot Block Version = 3.07.00.00-0004
Driver Name = megaraid_sas
Driver Version = 07.727.03.00-rc1

Here are relevant event logs:

seqNum: 0x000041bc
Time: Sun Jan 19 04:00:12 2025
Code: 0x00000072
Class: 0
Locale: 0x02
Event Description: State change on PD 17(e0xfc/s4) from ONLINE(18) to OFFLINE(10)
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
Previous state: 24
New state: 16
seqNum: 0x000041bf
Time: Sun Jan 19 04:00:28 2025
Code: 0x000000e7
Class: 0
Locale: 0x42
Event Description: Marked Missing for PD 17(e0xfc/s4) on array 0 row 0
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
Array: 0
Row: 0
seqNum: 0x000041c0
Time: Sun Jan 19 04:00:28 2025
Code: 0x00000072
Class: 0
Locale: 0x02
Event Description: State change on PD 17(e0xfc/s4) from OFFLINE(10) to UNCONFIGURED_GOOD(0)
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
Previous state: 16
New state: 0
seqNum: 0x000041c2
Time: Sun Jan 19 04:00:31 2025
Code: 0x00000071
Class: 0
Locale: 0x02
Event Description: Unexpected sense: PD 17(e0xfc/s4) Path 5000cca3c400a2d1, CDB: 93 00 00 00 00 04 8c 30 00 00 00 00 00 01 00 00, Sense: 6/29/02
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
CDB Length: 16
CDB Data:
0093 0000 0000 0000 0000 0004 008c 0030 0000 0000 0000 0000 0000 0001 0000 0000
Sense Length: 32
Sense Data:
0070 0000 0006 0000 0000 0000 0000 0018 0000 0000 0000 0000 0029 0002 0000 0000 0000 0000 0000 0000 00f5 0017 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
seqNum: 0x000041c3
Time: Sun Jan 19 04:00:31 2025
Code: 0x00000071
Class: 0
Locale: 0x02
Event Description: Unexpected sense: PD 17(e0xfc/s4) Path 5000cca3c400a2d1, CDB: 00 00 00 00 00 00, Sense: 2/04/01
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
CDB Length: 6
CDB Data:
0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
Sense Length: 16
Sense Data:
0072 0002 0004 0001 0000 0000 0000 0008 0003 0002 0000 0000 0080 0002 00f5 0002 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
seqNum: 0x000041c4
Time: Sun Jan 19 04:00:46 2025
Code: 0x0000010c
Class: 1
Locale: 0x02
Event Description: PD 17(e0xfc/s4) Path 5000cca3c400a2d1  reset (Type 03)
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
Error: 3
seqNum: 0x000041c5
Time: Sun Jan 19 04:00:46 2025
Code: 0x00000070
Class: 1
Locale: 0x02
Event Description: Removed: PD 17(e0xfc/s4)
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
seqNum: 0x000041c6
Time: Sun Jan 19 04:00:46 2025
Code: 0x000000f8
Class: 0
Locale: 0x02
Event Description: Removed: PD 17(e0xfc/s4) Info: enclPd=fc, scsiType=0, portMap=00, sasAddr=5000cca3c400a2d1,0000000000000000
Event Data:
===========
Device ID: 23
Enclosure Device ID: 252
Enclosure Index: 1
Slot Number: 4
SAS Address 1: 5000cca3c400a2d1
SAS Address 2: 0
seqNum: 0x000041c8
Time: Sun Jan 19 04:00:46 2025
Code: 0x00000072
Class: 0
Locale: 0x02
Event Description: State change on PD 17(e0xfc/s4) from UNCONFIGURED_GOOD(0) to UNCONFIGURED_BAD(1)
Event Data:
===========
Device ID: 23
Enclosure Index: 252
Slot Number: 4
Previous state: 0
New state: 1

Honestly, I'm at a complete loss. I would appreciate any help from people that know what they're doing.

4495
 
 
The original post: /r/datahoarder by /u/Hijadelpalmas on 2025-01-19 03:47:59.

I was literally in the process of trying to download all my tiktok favorites and likes, and they literally closed the app as of this moment...

Where I'm at is still 10:40pm... It hasn't even reached midnight yet. I should've done this mess earlier, ughhh.

4496
 
 
The original post: /r/datahoarder by /u/FarTooLittleGravitas on 2025-01-19 03:05:32.

This program uses data you can request from TikTok to try and rapidly download your favorites and likes to your system in order to back them up.

https://github.com/SparksCool/TikTokDL

4497
 
 
The original post: /r/datahoarder by /u/Icefox119 on 2025-01-19 01:12:33.

All the uploading, downloading, sharing, storing, archiving ... do you think the powers that be will eventually crack down on peer-to-peer type stuff and in the year 2050 we'll be saying things like "damn I can't believe they let us do all that stuff back then"

I'm just really scared for net neutrality. I feel like we don't even know how good we have it and one day in a few decades we'll all be dreaming of the good old days.

4498
 
 
The original post: /r/datahoarder by /u/scotchanddonuts70 on 2025-01-19 01:09:07.

Trying to download a friends faves but getting message that she has no likes or faves. Is she too late?

4499
 
 
The original post: /r/datahoarder by /u/Bobcat_Maximum on 2025-01-18 23:58:30.

I'm thinking to get a better SSD for caching, my motherboard is PCIe 3.0 though, do I have any advantages if I get 990 Pro vs 970 EVO Plus?

Now I have a Kingston NV2 and when downloading with 125MiB/s or unziping it drops to 0, then back to 125 and so on, this is the reason I want to upgrade, and I don't know which should I go from those 2.

4500
 
 
The original post: /r/datahoarder by /u/Ssonyk on 2025-01-18 23:21:23.

Hi, I'm looking for an m2ssd enclosure for a samsung 970 evo plus. I'm looking for something with a decent speed, and for me it would be important to not have a cable, to be exactly like an usb stick just so i can plug it in my tv without my cat "playing" with the cable. Thanks

view more: ‹ prev next ›