It's A Digital Disease!

The original post: /r/datahoarder by /u/Bitalin on 2024-10-10 21:05:04.

The original post: /r/datahoarder by /u/CaptainSur on 2024-10-10 20:54:30.

N 95/8gb - $499 after $100 Coupon

i3/16gb - $699 after $100 coupon

Relevant info:

• all raid formats supported including Raid 6
• Plex, Jellyfin support
• Virtualization
• upgradeable to 32gb ram

Most of the usage is going to be for downloaded critical backups from servers to an additional non-cloud source (me) for yet more backup redundancy (which would up the offsite & cloud locations to 6!) but may play with it for a variety of other purposes and it seems like it would be able to fulfill a variety of non backup tasks.

I was intrigued due to it being NVME as we have a bunch of these on hand - I think all in 2 TB format.

Anyways would welcome all thoughts from the datahoarder community on this. By no means am I stuck on nvme but as I was looking at synology deals I ran across this and thought "hey, that looks interesting" and we have drives on hand for it.

The original post: /r/datahoarder by /u/RacerKaiser on 2024-10-10 20:04:13.

Edit: I realised I wrote quite a bit, for the second question only the last paragraph is revelant

As you can tell from the title, this is a 2 parter.

Originally, it was simple. Macbook and Imac, and a synology which was final destination for files. Both time machined to the nas.

Due to various projects, data expansion, issues i've had with downloading directly to the nas and time machine taking forever on the nas this is no longer the case.

Current setup:

Imac has 2 4tb owc thunderbolt ssds as "work"(hoarding) drives, a samsung 2tb for time machine and a 4tb crucial x9 for photo library.

Macbook has 1 owc thunderbolt as work drive and a x9 4tb for time machine.

The synology is only for files at this point.

I picked up 2 more 4tb crucial X9's to backup the "work" drives on the imac, but I'm starting to think I have taken a wrong approach, having 6 external drives seems a bit silly.

Anyway, I was intending on using time machine with the new x9's but It appears it needs to be double the drive size.

I need the file modifications times to be identical so i was thinking cloning? But maybe it has to be something with a versioning system so the drive isn't always running.

Thanks for any suggestions!

The original post: /r/datahoarder by /u/xXDennisXx3000 on 2024-10-10 18:19:20.

The original post: /r/datahoarder by /u/Prestigious-Soil-123 on 2024-10-10 18:17:41.

Buy this.

Someone needs to buy this domain and archive archive.org. To archivearchive.org. Once you've got your hands on it, then you will need ~100 PetaBytes of storage, and thus probably about 800 PetaBits of internet throughput. This way, if archive.org loses some data to the DDOS, then they can recover it from archivearchive.org, and the other way around too.

The original post: /r/datahoarder by /u/bigfootheyy on 2024-10-10 17:29:01.

Here's the riddle:

A furious, data-hoarding wench has an AsusTor 4bay and only one 8tb drive in it, filled to the brim with shinies. They have two empty drives: 6tb and 12tb. The wench is broke, has no other drives, and no funds to buy additional drives. How can the wench get to a 12 tb raid 5 array without losing their shinies?

Been cracking my head open for at least a day without a solution. Help.

PS: The wench cannot reasonably be described as a Linux/Server-Wizard. It is only a sullen, furious, data-hoarding wench, after all.

The original post: /r/datahoarder by /u/RiggsGamer on 2024-10-10 15:42:02.

Anyone know of any libraries in/around New Braunfels/San Antonio, Texas that still have these drives??? Or anybody in the area that has a working one I could borrow??? :)

The original post: /r/datahoarder by /u/Odd_Anxiety5027 on 2024-10-10 13:14:12.

I ran out of SATA ports on my motherboard so I bought one of these:

https://www.amazon.ca/dp/B08KTFRFZW?ref=ppx_yo2ov_dt_b_fed_asin_title

Is this an acceptable way to power more hard drives? Any issues to look out for?

The original post: /r/datahoarder by /u/Mysterious_Plant_225 on 2024-10-10 09:54:11.

I want to purchase more storage without going broke and I was looking at these:

https://www.ebay.com/itm/166052947286?_skw=hdd&epid=13037063735&itmmeta=01J9TX52D21753NH2XTJ3Y2YBT&hash=item26a986e556:g:hxwAAOSw9jpki321&itmprp=enc%3AAQAJAAAAwHoV3kP08IDx%2BKZ9MfhVJKnzt7Y1TSYMGqiOcIrkGDT7keGIJ8uDnBiNRnkE5DL6E7sAbdoRp7OIiBd0NeTel7Onm12ZJxxNQrV%2FhF24jvBq4TdiC4hcYNz0peSoO9mGnHTbSgk4JebIsA9Ep6II0%2FNdlGvTcTbvWXwnQ67L%2BWzLuxVMoRES9gznJtXDESbhNLi2F3%2FFcD4sSx8wtnE66tdgQSr3GomDyDSWJHSBf7H1TpvBNYQTafdsa05aw5QUVw%3D%3D%7Ctkp%3ABk9SR9CmlN3OZA

I would like to know what you think about those.

The original post: /r/datahoarder by /u/moraliser on 2024-10-10 06:36:50.

Came across this linkedin post, what's this crazy idea, I tried and it actually works. Though I don't think it can be used to store more data unless more pixels are altered in a single frame and high resolution videos like 1080p and so on.

https://www.linkedin.com/posts/rithik-chopra_github-rithikricevidembed-video-data-embedding-algorithm-activity-7249504452489949184-jNn0?utm_source=share&utm_medium=member_desktop

Thoughts ?

The original post: /r/datahoarder by /u/_RouteThe_Switch on 2024-10-10 16:59:38.

I'm looking at buying a couple of more 8-bay units, but I can't decide if it makes sense to wait for the 1825+, so I figured I would ask the fellow hoarders where they land. I think the only rumored upgrades might be 2.5G nics, which is good but not mandatory for me.

Anyone know for sure they are upgrading and is there a reason besides the NICs I'm missing?

The original post: /r/datahoarder by /u/GalaxyS3User on 2024-10-10 16:18:59.

The original post: /r/datahoarder by /u/4619 on 2024-10-10 15:44:32.

I've been using the MX500 series SSDs in various capacities for many years and they have been reliable for my case. I remember looking out for news of a hopefully 8TB version long before covid. Not only didn't any brand deliver a proper 8TB TLC, all drives have had a huge increase in price since i last bought one in the last 1-2 years, the MX500 also are no longer beeing sold by amazon for a few weeks now and the third-party sellers want 320$ for the 4TB version. Just out of stock, discontinued? Any particular info on Crucial? WTF is going on.

The original post: /r/datahoarder by /u/ToxicDuckl1ng on 2024-10-10 15:01:50.

Is the amber x cloud storage device safe? I’m not very well versed in this but if I connect it to my WiFi, does it create a back door to my WiFi? Are my files on that device going to be protected? I’m asking here cuz I didn’t see anything on the internet about its safety.

This is the device in question.

https://a.co/d/dRe1GHS

The original post: /r/datahoarder by /u/hellomoto8999 on 2024-10-10 14:34:53.

I want to replace my home server just because it's a space of waste in my room. I found on wallapop son qnap Nas, for example ts-231p for 90€. Is it worth it? actually I have Nas virtualized via omv on proxmox so I think that qnap nas would be more powerful. Any other nas hw alternative is appreciated.

The original post: /r/datahoarder by /u/Sunlit_Neko on 2024-10-10 14:11:22.

Does anyone know what style screws fit the top four hex screws which have a philips head. I hate using the hex tool, and the standard phillips screws I already have don't match the threading measurements.

The original post: /r/datahoarder by /u/GTurkistane on 2024-10-10 13:46:19.

The only time i will plug it in is when i want to store the things i already played/watched then unplugged it and store it away, so at that point does 7200 speed is important?

The original post: /r/datahoarder by /u/T-nash on 2024-10-10 10:53:52.

Basically I am about to start converting VHS tapes to digital using uncompressed YUV422BT.601 VCM on virtualdub capturing with Hauppauge WinTV-HVR-1250.

The video files are like 300GB large for obvious reasons, I do not wish to process them today and leave enhancing them in the future once software improves further.

That said, I downloaded a test video from the internet in the format of YUV4MPEG2 4:2:0 in y4m container, and used

ffmpeg -i elephants_dream_1080p24.y4m -c:v libx265 -preset slow -x265-params lossless=1 -pix_fmt yuv420p I:\output_lossless_x265.mkv

The video size went from 47,661,505 KB to 5,581,389 KB, which is great

Then to test restoring it back to the original form I used

ffmpeg -i I:\output_lossless_x265.mkv -c:v rawvideo -f yuv4mpegpipe elephants_dream_restored.y4m

The restored file had the exact same original size of 47,661,505 KB, media info matched, but MD5 checksum didn't, I assumed it had something to do with the header, so I extracted the same frames on both source and restored videos and checksummed those, the hashes matched, meaning they're pixel perfect :)

Anyway, I tried archiving with winrar as well using these settings

create solid arhive

add recovery record (10% record)

Lock archive

1GB dictionary size

split volumes in 2GB

compression method: best

I ended up with a total of 9.64GB file size after compression.

So,

Source: 47.6GB

x265 lossless: 5.5GB

Winrar: 9.64GB

I will be storing on an unraid array running XFS with a parity disk, I do not have ECC rams, I am not familiar with bit rot and those factors about data storage, I am just wondering which would be the best choice between winrar with recovery archives or x265 lossless, I just don't want to come back 5-10 years later and find them damaged. It's worth nothing I don't always replace hdd's with slight errors, don't always have the budget.

Here's media info if anyone is interested

Source video:

Complete name                            : E:\elephants_dream_1080p24.y4m
Format                                   : YUV4MPEG2
File size                                : 45.5 GiB
Duration                                 : 10 min 53 s
Overall bit rate                         : 597 Mb/s
Frame rate                               : 24.000 FPS
Video
Format                                   : YUV
Duration                                 : 10 min 53 s
Bit rate                                 : 597 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 24.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Scan type                                : Progressive
Compression mode                         : Lossless
Bits/(Pixel*Frame)                       : 12.000
Stream size                              : 45.5 GiB (100%)

X265 --lossless

Unique ID                                : 228437949554887390664296614558885315335 (0xABDB8C7AC3616332E7D3FDA223B18307)
Complete name                            : E:\elephants_dream_1080p24_output_lossless_x265.mkv
Format                                   : Matroska
Format version                           : Version 4
File size                                : 5.32 GiB
Duration                                 : 10 min 53 s
Overall bit rate                         : 69.9 Mb/s
Frame rate                               : 24.000 FPS
Writing application                      : Lavf61.5.101
Writing library                          : Lavf61.5.101
ErrorDetectionType                       : Per level 1

Video
ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main@L8.5@Main
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 10 min 53 s
Bit rate                                 : 68.5 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 24.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 1)
Bit depth                                : 8 bits
Bits/(Pixel*Frame)                       : 1.377
Stream size                              : 5.22 GiB (98%)
Writing library                          : x265 4.0+4-28de550a2:[Windows][GCC 14.2.0][64 bit] 8bit+10bit+12bit
Encoding settings                        : cpuid=1111039 / frame-threads=4 / numa-pools=16 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=1920x1080 / interlace=0 / total-frames=0 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=4 / no-allow-non-conformance / no-repeat-headers / annexb / no-aud / no-eob / no-eos / no-hrd / info / hash=0 / temporal-layers=0 / open-gop / min-keyint=24 / keyint=250 / gop-lookahead=0 / bframes=4 / b-adapt=2 / b-pyramid / bframe-bias=0 / rc-lookahead=25 / lookahead-slices=4 / scenecut=40 / no-hist-scenecut / radl=0 / no-splice / no-intra-refresh / ctu=64 / min-cu-size=8 / rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=2 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=3 / limit-modes / me=3 / subme=3 / merange=57 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / rd=4 / selective-sao=4 / no-early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / no-b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=1.00 / no-rd-refine / lossless / cbqpoffs=0 / crqpoffs=0 / rc=cqp / qp=4 / ipratio=1.40 / pbratio=1.30 / aq-mode=0 / aq-strength=0.00 / no-cutree / zone-count=0 / no-strict-cbr / qg-size=64 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=0 / colorprim=2 / transfer=2 / colormatrix=2 / chromaloc=1 / chromaloc-top=1 / chromaloc-bottom=1 / display-window=0 / cll=0,0 / min-luma=0 / max-luma=255 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / no-opt-cu-delta-qp / no-aq-motion / no-hdr10 / no-hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / scenecut-aware-qp=0conformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0 / no-vbv-live-multi-pass / no-mcstf / no-sbrc
Default                                  : No
Forced                                   : No
Color range                              : Limited

Restored from x265 --lossless to YUV

Complete name                            : E:\elephants_dream_restored.y4m
Format                                   : YUV4MPEG2
File size                                : 45.5 GiB
Duration                                 : 10 min 53 s
Overall bit rate                         : 597 Mb/s
Frame rate                               : 24.000 FPS

Video
Format                                   : YUV
Duration                                 : 10 min 53 s
Bit rate                                 : 597 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 24.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Scan type                                : Progressive
Compression mode                         : Lossless
Bits/(Pixel*Frame)                       : 12.000
Stream size                              : 45.5 GiB (100%)

The original post: /r/datahoarder by /u/StefanoDP on 2024-10-10 10:14:24.

Hi everyone! First of all, thank you in advance for your responses!

I am an editor and i’m following several projects. At the moment, my storage workflow consists in doing a copy on a 4Tb Wd 2.5” HDD, as backup, and another on a SanDisk SSD which is the drive i’ll have plugged in to work on. After the work is done, i empty the sdd and keep the hdd copy.

This is my idea: I was thinking on buying a 2-Bay DAS (Terramaster D2-320) and use it in RAID-1 mode. In the Bay 1 i’d mount a good 12Tb HDD and in the Bay 2, i’d mount a cheaper 12Tb HDD for a mirror backup. My idea is that when i eventually fill up the disks, i’ll remove the cheap copy and store it to keep a copy. (Considering it’ll be full of delivered and finished projects that i’d keep just for safety or portfolio reasons) Then i’ll erase the good 12Tb and mount a new cheap 12Tb as his backup.

My question is: Which HDD are best suited for this idea? I’ve heard that some Seagates are not so reliable…

And, considering that i’m working on a budget 😅, could it be a good solution? Do you have a better option?

Thank you again!

The original post: /r/datahoarder by /u/MG-31 on 2024-10-10 10:03:43.

Hi! I am not sure if this falls under this subreddit but I had to ask since I did collected movies and shows over the past decade(almost 15TB) and want to expand, recently a PC shop near my place went full Black-Friday mode before black Friday and snatched few things at almost half the price as they were something I was looking for, here's what I got for almost 600$: Threadripper 2920x, 2x8TB HDD, 2x2TB M.2, and 2TB SSD type-c

I am not bragging but the 2x8TB and the 2xTB were all decent deal, brand new, no issues until I thought "hey why not just build NAS server?" And I immediately brushed it because one I have no place in my room for a massive server case so the Threadripper is a no go(just gonna put it for show on the shelf).

I looked around and wanted to know what should look for if I want to build something not necessarily too small but also not necessarily big, for the lack of a better word I did some comparison and measurements and found the best place to fit one would be roughly bigger than the Jonsbo N3 by an 6cm in height and 8cm in width(assuming you looking at the front of the case) as for depth plenty of space around 14cm to manage cables and airflow. The reason why I choose that place its because where the ethernet port in my room is the closest to, luckily I don't have any use for it yet and can't install fiber because the tube are smaller in diameter but the only use case i have for it would be to pass files or streaming purposes since the port happens to be next to the split port(where the ISP brings the cable and pass it around the house)

In terms of specs I am not looking for the "High-end" but also not "Barely", mostly basics of the "must have" what should I look for if I am building a small NAS and assuming its something like the Jonsbo N3(it looks good ngl), and if thats not option then should I consider using the Threadripper? I know what it can do but again it will be difficult to place in a room already small and my main PC doesn't excatly have the space for extra storage drives

I know someone will ask this question "why not just make the ISP make the Fiber cable usable on your port?" And to answer that as respectfully as I could I am not gonna dig and break walls and pays almost 11 times the price, without the cables mind you, just to get faster internet network speed(I am not being sarcastic here, we looking at almost 16K$ with the cables)

The original post: /r/datahoarder by /u/redneptun on 2024-10-10 09:32:20.

The original post: /r/datahoarder by /u/Rotelle on 2024-10-10 06:28:42.

man, the internet archive really did not need more on its plate right now

as we all know, if you care about something, save it. if it gets taken down, you still have it. great! but what about getting that thing to other people? a lot of people here mention that they care a lot about the preservation. but if you're the only person in the world who still has a copy of something, it's basically still lost media to everyone else.

torrent trackers make this content not only available, but incentivize people to keep it up. you can see the number of seeders on something, which shows how many other people are also sharing it. having additional seeders allows people to download that data faster, but is a built-in system for redundancy - if one person loses that data, the other 49 seeders are still there.

while not outright required, i'm moreso talking about private torrent trackers here. you've probably heard of public ones like thepiratebay (lol) and while those do still work, because they don't track stats on individual users, people tend to just visit to pick something up and then immediately leave once they have it. semi-private and private trackers not only have rules about holding the door open for a certain amount of time, but they're often organized better, have a more focused scope, and a greater sense of community.

The original post: /r/datahoarder by /u/SurpriseGmg on 2024-10-10 05:11:26.

Just checking by real quick since I can't really find any info online - So basically, I have one of those large external hard drives that requires its own external power cords - I've noticed recently that a mini fridge I had plugged into the other outlet would typically cause a brief trip in which inputs like my mouse noticeably freeze for a second. I've most definitely copied data in the middle of one of these trips before, so is it possible that something like this could potentially cause some sort of data loss? I don't believe the hard drive has ever disconnected or stopped spinning during any of these GFCI trips, but I figured I'd check anyway and see if it was worth copying over some of these files a second time (I'm going to assume these trips haven't damaged the drive itself since it still works fine).

The original post: /r/datahoarder by /u/720hp on 2024-10-10 02:50:35.

For the time being I was thinking of using a single desktop WD 16TB external drive while I build a new NAS with an old Ryzen pc.

What issues can I expect transferring 9+ TB from the old Drobo to the newer disk?

Thanks!

The original post: /r/datahoarder by /u/godis1coolguy on 2024-10-10 02:39:59.

It’s been a while since I’ve digitized VHS tapes. It took me a while fiddling with settings on the camera to remember how to pass through the signal from the VCR. I went to Goodwill and grabbed the bottom VCR. My Mac will see signal from the dvd player, but on the VCR side it just gets a Samsung screensaver. The model is Samsung DVD-V9650. I grabbed it because I read on here that sometimes these combo units are better and it has S-Video Out. I don’t have a remote. Does it seem like this unit is a dud? The timer counts as if it’s playing the tape, but I can’t get it off the screensaver when set to VCR

I’m currently using the bottom VCR that I already had laying around, but it only has the RCA out and I know that’s an inferior option. Does anyone have any advice on trying to get the combo unit working or should I just run with what I have working with the Sanyo?

https://ibb.co/8xS08mN