The original post: /r/datahoarder by /u/bloepz on 2024-05-29 06:47:35.

I currently have 2*3TB in RAID1 (HDD) and have two new disks (6TB HDD) which I want to use instead.

It is encrypted and looks like this:

/dev/sd(d,e)1 (partitions) -> /dev/md1 (raid1) -> /dev/mapper/raid1 (crypt) -> /files/raid1 (ext4)

Is it better/faster to:

• Create a new RAID1 on the two 6TB, encrypt it, create filesystem and copy the data from the old RAID1 to this new RAID1

or

• Add disks to the existing RAID1, grow it and resize the crypt and fs like this:

mdadm /dev/md1 --add /dev/sdf1 /dev/sdh1 --replace /dev/sdd1 /dev/sde1 --with /dev/sdf1 /dev/sdh1

mdadm /dev/md1 --remove /dev/sdd1 /dev/sde1

cryptsetup --resize /dev/mapper/raid1

resize2fs /dev/mapper/raid1

Availability is not an issue - it can be offline for the whole time. I'm assuming growing the existing would take more time but that's purely a guess. And does one of those models do more wear on the new disks?

The original post: /r/datahoarder by /u/AriFeblowitzVFX on 2024-05-29 05:35:44.

I just bought one of these things on Ebay assuming that if it hooks up to your camera via firewire and records direct from camera to flash card, that it could handle recording tapes to a flash card right?

Well, the manual only talks about recording with the camera and has nothing about playblack/digitizing,. why would it not have that feature?

Does anyone know if there's a way to use these to digitize?

The original post: /r/datahoarder by /u/boglim_destroyer on 2024-05-29 05:33:00.

I just set up my DS224+ with mirrored 16tb drives and am currently backing up to a 5tb external, as my data can fit on that currently. However this will not always be the case and I am planning for when that time comes.

I have 6 x 4tb drives that are not in use and I would like to find a USB RAID enclosure for these that I can run RAID 5 with a hot spare or RAID 6. Does anyone have any recommendations on an enclosure?

The original post: /r/datahoarder by /u/8yp00o19pB14Ic on 2024-05-29 03:39:50.

atm i have a sff hp thin client running linux, set up as a samba file server. got all my data on a 1 tb toshiba usb hdd. about 700 gb of photos and documents, music and movies....

i bought a 2 tb seagate usb hdd for a great price this week because i want to back up the data on the toshiba hdd, i dont trust all my data being on a single drive jic it fails.....

my plan was to copy all the data from the toshiba to the seagate, set up the seagate as the new file server drive, and then i was going to set up the file server to do a weekly incremental backup on the toshiba drive. basically set the file server to back up the seagate drive to the toshiba drive weekly...

i have done backups before, backing up my laptop's 256 gb ssd to the toshiba drive, no issues there.

part of me wonders if its possible to compress down a backup of a drive and fit it into a smaller drive, say theoretically i had 1.2 tb worth on the seagate drive and compress it and store the backup on the 1 tb toshiba drive.

if i could back up a larger drive into a smaller drive using compression, id be able to take advantage of that 2 tb instead of the opposite way around, where i only have 1 tb to play with and im backing up to a 2 tb drive.

what am i missing, is this possible to do?

The original post: /r/datahoarder by /u/ark1one on 2024-05-29 02:47:59.

Request for Help: Dell PowerEdge R730XD Server Not Recognizing RAID Card Connected to NetApp DS4246 JBOD

Server and Hardware Details:

• Server: Dell PowerEdge R730XD
• JBOD: NetApp DS4246
• HBA Card: Sun Oracle 7047853 8-port 6Gbps SAS-2 HBA SGX-SAS6
• Cables: Two CAB-QSFP to SFF-8088 Hybrid Mini SAS Twinax Copper Passive Hybrid Mini SAS Cables

Current Setup:

• The Sun Oracle HBA card is installed in the Dell PowerEdge R730XD server.
• The hybrid mini SAS cables connect the HBA card to the NetApp DS4246 JBOD.

Issue:

• The Dell server does not recognize the RAID card via BIOS or iDRAC.
• The internal LED on the HBA card is blinking green slowly.
• The link light on the JBOD port is inactive.

Steps Taken and Observations:

1. Swapped Cables:
   • I switched the hybrid mini SAS cables to rule out any cable-related issues. Despite this, the server still did not recognize the RAID card, and the JBOD link light remained inactive.
2. Tried Another Identical HBA Card:
   • I used a second, identical Sun Oracle HBA card to check if the first card was defective. Unfortunately, the server still did not detect the RAID card, indicating the problem might not be with the HBA card itself.
3. Tested Different PCI Slots:
   • I installed the HBA card in various known working PCI slots within the server to ensure there was no issue with the PCI slot. This did not resolve the problem, as the RAID card was still not recognized.
4. Updated Firmware:
   • The server is running the latest version of Dell's firmware. I confirmed this to rule out any compatibility issues due to outdated firmware.
5. LED and Link Light Observations:
   • The internal LED on the HBA card blinks green slowly, suggesting some activity or standby mode. However, the link light on the JBOD port is not lit, indicating a lack of communication or recognition between the devices.
6. Connected to Windows Machine:
   • I connected the HBA card to my Windows machine, and it was recognized correctly. This confirmed that the card itself is functional. I proceeded to update the firmware on the card.
7. Firmware Update on HBA Card:
   • I updated the HBA card to the latest firmware. Now, both the Dell server and the HBA card are running the latest firmware.
8. Attempting JBOD Firmware Update:
   • Updating the firmware on the NetApp DS4246 JBOD has been a significant challenge. The website requires waiting to access their third-party software to manage the controller and update the firmware. This process has been extremely cumbersome, with numerous hoops to jump through just to get the firmware updated.

Challenges and Need for Help:

1. Firmware Validation:
   • Challenge: I am unsure how to check and update the firmware for both the Sun Oracle HBA card and the NetApp DS4246 JBOD.
   • Need Help: Guidance on how to validate and, if necessary, update the firmware for both devices. This might help ensure they are compatible and functioning correctly.
2. JBOD Configuration:
   • Challenge: I am unclear on how to configure the NetApp DS4246 JBOD to properly recognize and communicate with the HBA card.
   • Need Help: Step-by-step instructions or resources on configuring the JBOD to establish a proper connection with the HBA card. This includes any necessary settings or procedures that need to be followed.
3. Diagnostic Tools and Methods:
   • Challenge: The system lacks a web front-end and outputs only to SolarWinds servers, which I prefer not to set up. I tried using PRTG Network Monitor but could not read any output ports.
   • Need Help: Recommendations for alternative diagnostic tools or methods to monitor and validate the connection between the server and the JBOD. Any tips on interpreting the LED signals or other diagnostics would also be appreciated.

Summary: Despite my efforts in swapping cables, trying another identical card, testing different PCI slots, updating the server firmware, and even confirming the HBA card's functionality on a Windows machine, I am still unable to get the Dell PowerEdge R730XD to recognize the RAID card or establish a proper connection with the NetApp DS4246 JBOD. The firmware update process for the JBOD has been particularly frustrating and convoluted. I am looking for advice on firmware validation, JBOD configuration, and effective diagnostic tools to resolve this issue.

Thank you in advance for any help and suggestions you can provide!

The original post: /r/datahoarder by /u/Zrh87 on 2024-05-29 01:54:31.

Has anyone seen a full collection of this anywhere. I’ve been looking by I can’t find it. So I thought at this point I’d reach out and see if one of you might have seen it floating around somewhere.

The original post: /r/datahoarder by /u/mro2352 on 2024-05-28 22:53:57.

I’m wondering when firmware from dvd drives didn’t have a flash chip but actual rom.

The original post: /r/datahoarder by /u/Strange_Advisor_ on 2024-05-28 20:39:09.

So as things grow I find myself replacing disks with bigger ones, replacing enclosures with Nas and das and now im at the point of what do I do with the obsolete stuff ? I have about 6 x 2 TB hdd and 1 x 3 TB hdd and one old ProBox that I am retiring with my upgrade ... do I just leave them on a shelf? Do I yeet them? There is nothing really important on them, just movies and tv shows, but it seems like a waste to toss them and seems like a waste to keep them. Thus i have no idea what do so ... so what does everyone else do? Thanks fam !

The original post: /r/datahoarder by /u/poptrek on 2024-05-28 19:00:09.

I was looking for any kind of script or docker image that can help. My horde has gotten very bloated again. I have tried Fileflows(Docker image is broke on version 24.05+ for me), Tdarr just doesn't provide enough customization, and I don't feel like learning how to code my own plugin, & Handbrake docker doesn't have permissions to launch NGIX for me.

I was thinking of a script with find, a txt file for processed files, ffmpeg, and watch. Because I would like to do everything in AV1 and I have an A380 available in my server for transcodes. As any one done a script like this or know of one? I can reinvent the wheel but I would prefer to have a starting point. Thanks

The original post: /r/datahoarder by /u/UltraNigatelo1911 on 2024-05-28 17:33:53.

https://resubscene.vercel.app/

A subtitles database website using all the data that was dumped before subscene closure (Only extracted Arabic & English subtitle)

website screenshot

The dump was massive with over 2 million extracted subtitle files (deduped & counting only english & arabic)

With over 75 GB of extracted files

and 1.2 GB of just the metadata

The whole goal of this project was to provide a website to access this vast amount of subtitles accumulated over the years of subscene operation

and also an opportunity to improve the horrible user experience the website suffered from, and the slow and inaccurate search, inability to download individual .srt; .ass; files directly.

I plan on adding the missing languages and open sourcing the whole project alongside the processed data

Huge thanks to the Subscene dump:

Subscene.com full Dump : r/DataHoarder (reddit.com)

The original post: /r/datahoarder by /u/Misclickable on 2024-05-28 17:13:29.

Hi. I would like to organize my backup of pictures and videos of my iPhone. I've been importing the pictures and videos on my iPhones to my PC for the last decade. Sometimes the import function didn't work as expected and I had to import everything all over again. Long story short, I now have 3 folders:

Folder 1: Old pictures that are in DICM folders. It branches out quite a bit and their names are IMG_0001.

Folder 2: A folder with pictures and videos split into two folders.

Folder 3: Main folder that I want everything to be in. Most of it is right, but I'm sure it is missing the older pictures and videos in Folder 1.

What I'm looking for:

• I want the pictures and videos to be chronologically placed so I can go through them without interruption.

• Preferably a program that would look at the 3 folders and create a new folder with all the files organized like 2024-05-28_IMG_0001.

• Remove duplicates so they don't occupy space unnecessarily. It could check if the file was created at the same time, instead of comparing the files one by one.

What I've done so far:

• Tried using AntiDupl.NET but it would take too long to sort them one by one.

• Tried using dupeGuru but I can't verify the files actually being duplicates.

A slight problem could be that some images are in .HEIC and some videos are in .HEVC format. I don't mind them being in that format as I use ImageGlass to view the pictures and VLC to view the videos.

Extra: I'd appreciate if anybody have a good method of backing up their pictures and videos on their iPhone.

The original post: /r/datahoarder by /u/AriFeblowitzVFX on 2024-05-28 16:47:17.

Here are the 3 problem machines:  

• VTR NTSC - Thomson TTV 3450 N
• Sony DVW-A510
• Betamax EDV-7000

TTV 3450- 

Error code 009, eject button doesn’t work, no video signal output, not even for menu or time codes

DVW-A510- everything works except for the Channel condition doesn’t light up and the video signal from the tapes are blank gray with no audio, but the menu, time code, and color bars all output and the tape plays/rewinds/ejects fine.  

EDV-7000-

This one a tape got stuck and none of the tape buttons like play or eject are working

I only need one of the digibeta decks repaired and I should be good, but it would be good to at least get the tape out of the Betamax deck as well.

Anyone know of anyone in Minnesota who fixes these things?  As you could guess I’ve been having bad luck trying to get a working digibeta deck on EBay haha.  

The original post: /r/datahoarder by /u/ngs428 on 2024-05-28 15:00:52.

I have about 13,000 text (song lyric .lrc) files saved music file folders. The are several hundred folders in this structure.

I am looking for a program that can scan the folder and give me a view of the encoding types on each of the .lrc files. Some are saved as UTF-8-BOM and I need to remove the BOM, saving them as UTF-8 only.

Something like the document list in Notepad++ but having an “encoding” column.

Or maybe there is a better way to accomplish what I am trying to do? Any help would be appreciated! Thanks!

Edit: I just found EncodingChecker at:https://github.com/amrali-eg/EncodingChecker This is what I am looking for. I will leave the post up for anyone with the same question in the future.

The original post: /r/datahoarder by /u/drupadoo on 2024-05-28 12:29:05.

Like everytime I watch a youtube video, just download it and back it up. Same with every reddit image I look at. Etc.

The original post: /r/datahoarder by /u/Acceptable_Cook_8112 on 2024-05-27 10:02:02.

hey i have been struggling to download a neo cities website i want because i tried doing it with htttrack and it didnt work because it didnt give me alll the sources /; idk how to download it with the full sources. im downloading it because i wanna edit the code and modify it so it can fit my aesthetic lol

The original post: /r/datahoarder by /u/GloomyAction on 2024-05-28 10:28:55.

The original post: /r/datahoarder by /u/TheRealShubshub on 2024-05-28 09:32:38.

Looking for a copy of the forum archive from back in the day if anyone has it?

The original post: /r/datahoarder by /u/Soolidus on 2024-05-28 04:34:29.

WD HDD. Got slower and slower the closer it got to full capacity, which I thought was normal, but I recently deleted 3 TBs worth and it's still the same. Any way to fix it? Is this normal?

The original post: /r/datahoarder by /u/Designer_Stick6772 on 2024-05-28 03:59:53.

If so, would it be possible to share your account with me just for 1 day? There’s like about 300 GB worth of porn in 4k that I wanna stash just incase they get deleted from the internet haha, being honest atleast :)

The original post: /r/datahoarder by /u/Teeeeze on 2024-05-28 03:08:21.

I have a few nvme drives that are not currently used lying around in my house. But I think there’s a certain way to store and preserve it but not sure.

I searched on the internet and YouTube but no clue.

The original post: /r/datahoarder by /u/bradyripka on 2024-05-27 18:50:32.

Hello Friends,

I know similar questions have been answered (such as https://www.reddit.com/r/DataHoarder/comments/eh236m/how\_to\_organized\_scanned\_family\_photos/) but my question is slightly different so please don't shoot the messanger.

I am working on scanning my family's moderately sized photo library. The process itself is very easy, but figuring out how to organize the photos in a chronilogically based tool has been the issue. SO much so that my perfectionistic self hasn't made progress on this project in 2 years. PLEASE HELP.

Summary:

• my main storage location is Google Photos with secondary of Apple Photos and Amazon Photos
• Not all the photos have meaning to me but I'm currently scanning everything
• So far, my approach has been, if it's fairly recent photo date it as January 1, 2000 (more meaningful to me), if it's an old photo date it as January 1, 1901 (more meaningful as just having family photos). That way they are at least in a similar location when I scroll google photos.
• SOME of them have dates on the envolope but most don't. I'm torn as to whether I should date those or keep them in the generic buckets with the others (see bullet above)
• FWIW, the idea that two photos from the same event don't end up next to each other in the library drives me nuts, but that might just be life I suppose.

Any thoughts on best way to organize them?

Side question, has there been any AI based tools released lately which can help to organize? Honestly, that's part of my hope in parking the photos at a certain date for now in the hopes that more advanced tools come along.

The original post: /r/datahoarder by /u/Hilarsky on 2024-05-27 16:06:30.

So, just after I bought 1165g7 nas from topton I found this from CWWK, which on paper looks amazing to me.

In theory it supports up to 6x nvme with this odd extension board you can buy with this bundle, however they're stating on product page that it doesn't support pcie 4.0 nvme drives (which sounds like bs to me )

My question is , does anyone has this board ? Works ok ? Anyone seen any information regarding sff 8643 -> to pcie ? google produces only garbage results ...

https://www.aliexpress.com/item/1005007029671776.html?pdp_npi=4%40dis%21GBP%21%EF%BF%A1321.66%21%EF%BF%A1160.83%21%21%21398.00%21199.00%21%40210384cc17168245681252058e0b43%2112000039151333112%21sh%21UK%210%21

The original post: /r/datahoarder by /u/Flat_Okra_6638 on 2024-05-28 01:39:12.

I've heard good things about Tape, as well as NAS, but am unsure of the best approach.

The original post: /r/datahoarder by /u/ineedacocktail on 2024-05-27 23:53:27.

Not sure how or where to ask for this.

A while back I got my hands on a MacGyver bootleg from the late 90s, I believe it was the first season.

Now, my memory is fuzzy, but episode 7, at the end, had an open mic on the guy that was recording the episode and you hear, “hit that shit, MacGyver!” and it was one of the greatest experiences of my life.

Like seeing a star explode.

I want that recording, or, to high five the person that made it.

If I had to guess I would say they made the recording around 1998 based on my original source.

The original post: /r/datahoarder by /u/covered1028 on 2024-05-27 22:51:56.

Right now I am plugging each drive 1 by 1 and have backblaze back up each drive while I figure out my setup but I will run out of drive letters soon.

One solution I thought about was that when I run out of drive letters, I will reuse a drive letter and for that drive make a new folder moving all data in there so I would know what data I lost and I can restore it by going through the time machine thing.