It's A Digital Disease!

The original post: /r/datahoarder by /u/Engine-International on 2024-10-01 19:40:39.

One of my Crucial MX500's has a huge TBW value (I'm thinking it was caused by a wrong Windows migration).

The factory specified tbw is 150, but I measure 588TBW on this one.

Could this be real or a software bug?

First I ran a short and a conveyance self-test on it, both passed.

The long stuck with an error, so I did a destruct on it with the KDE partition manager.

Now the long runs without errors and if I read it right, there are plenty of spare sectors.

Do you think this SSD is still usable?

I attach the smartctl and badblocks report below:

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (  30) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x0031) SCT Status supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   100   100   000    Pre-fail  Always       -       0
  5 Reallocate_NAND_Blk_Cnt 0x0032   100   100   010    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       8039
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       53
171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
173 Ave_Block-Erase_Count   0x0032   247   247   000    Old_age   Always       -       5488
174 Unexpect_Power_Loss_Ct  0x0032   100   100   000    Old_age   Always       -       18
180 Unused_Reserve_NAND_Blk 0x0033   000   000   000    Pre-fail  Always       -       47
183 SATA_Interfac_Downshift 0x0032   100   100   000    Old_age   Always       -       0
184 Error_Correction_Count  0x0032   100   100   000    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
194 Temperature_Celsius     0x0022   062   035   000    Old_age   Always       -       38 (Min/Max 0/65)
196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
197 Current_Pending_ECC_Cnt 0x0032   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   100   100   000    Old_age   Always       -       1
202 Percent_Lifetime_Remain 0x0030   247   247   001    Old_age   Offline      -       109
206 Write_Error_Rate        0x000e   100   100   000    Old_age   Always       -       0
210 Success_RAIN_Recov_Cnt  0x0032   100   100   000    Old_age   Always       -       0
246 Total_LBAs_Written      0x0032   100   100   000    Old_age   Always       -       1263022909412
247 Host_Program_Page_Count 0x0032   100   100   000    Old_age   Always       -       20888923422
248 FTL_Program_Page_Count  0x0032   100   100   000    Old_age   Always       -       37710666859

SMART Error Log Version: 1
Invalid Error Log index = 0x07 (T13/1321D rev 1c Section 8.41.6.8.2.2 gives valid range from 1 to 5)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      8037         -
# 2  Conveyance offline  Completed without error       00%      8012         -
# 3  Short offline       Completed without error       00%      8012         -

badblocks -wsv /dev/sda

Checking for bad blocks in read-write mode
From block 0 to 488386583
Testing with pattern 0xaa: done
Reading and comparing: done
Testing with pattern 0x55: done
Reading and comparing: done
Testing with pattern 0xff: done
Reading and comparing: done
Testing with pattern 0x00: done
Reading and comparing: done
Pass completed, 0 bad blocks found. (0/0/0 errors)

The original post: /r/datahoarder by /u/MuscleLazy on 2024-10-01 19:03:09.

I purchased a Fractal Design Define 7 XL case, where I will install TrueNAS Scale, as OS.

So far, these are the specs I plan to use:

• AMD Ryzen 7 5800X processor
• ASRock B550M Steel Legend motherboard
• 18 x 8TB NAS spinners for media storage pool
• 2 x 256GB SSD’s for TrueNAS OS

I need your advice what components do you recommend me to purchase, for TrueNAS running smoothly, without performance issues, while avoiding excessive power consumption. Please let me know if the motherboard or processor are the recommended ones. For example, I’m not sure what power supply capacity I should use.

Also, I’m not sure how I will connect 18 spinners and probably 5 SSD’s to the motherboard. I’m used to build a NAS on Dell servers, where they come with the required hardware. Is the first time I’m building a NAS, based on a desktop case. Thank you for your help.

For reference, my current NAS build: https://www.truenas.com/community/threads/103823/

The original post: /r/datahoarder by /u/tachibanakanade on 2024-10-01 18:44:16.

I bought an WD Ultrastar, 10TB for $80 from Newegg. It was refurbished, but it seemed like a steal, so I bought it anyway. Since it was so affordable and since I didn't wanna miss out on it, I bought it. But I should have done some research first (I know, dumb to buy first and ask question slater). But are WD Ultrastars good for a NAS? Specifically, would it be good for a WD MyCloud EX2 Ultra? Thanks in advance!

The original post: /r/datahoarder by /u/New_Assignment_1683 on 2024-10-01 18:37:44.

so i have a build now with a micro atx mobo 16gbram 3 3200g and with the drives it is excpected to use about ~230-~240watts and the full price withouth hdd is about ~250$ (with hdd ~500$) so my question is does anybody have a more efficient/cheaper option for the computer part the mobo needs to be micro atx to fit in the case i would greatly appreciate it (excuse my english)

The original post: /r/datahoarder by /u/barris59 on 2024-10-01 17:05:03.

The original post: /r/datahoarder by /u/Quick_Boss_7188 on 2024-10-01 14:48:34.

Just saw a guy here asking how best to digitize a magazine. Commenters told him the best way would be involve completely damaging the magazine, and the OP responded with "something like "that's okay i'm not/wasn't gonna read it anyway" So what's the point? One random magazine you'll never look at again doesn't make much sense to me. I get it's HOARDING but still. It takes a lot more work to destroy a magazine, digitize it, upload it, and never see it again than it would be to just throw it in a corner of the house with all the other magazines. Thanks!

The original post: /r/datahoarder by /u/Revolutionary_Ad6574 on 2024-10-01 14:39:13.

I know these are rookie numbers for this sub but that's all I need. My whole digital archive fits into 1TB but I still want to make damn sure I never lose any of it. Currently I have an external 1TB WD SSD which I plug in only once every 2-3 months to copy new files. I do that because I just assumed that the less I use it the safer it is. But skimming through the sub I've found a term called "cold storage". I assume it means just keeping your data in your drive and use it only when you need it as opposed to keeping it plugged all the time and using it constantly. I don't know if "cold storage" is a good or a bad thing but seeing posts about it makes me wonder.

Am I doing it wrong? Or is this the safest way to handle my data? Should I switch to a HDD? Or is it enough to keep my SSD plugged in?

Keep in mind I'm looking for the simplest "good enough" solution. If what I'm already doing falls in that category then so be it. I'm just disclaiming that because I'm not looking for advice on setting up RAID or this new kid on the block NAS etc, I'm not an enthusiast, my interests lie elsewhere. I just want to make sure I'm not doing anything obviously wrong.

Also, I'm not looking for cloud storage, I'm only interested in offline.

The original post: /r/datahoarder by /u/Chava_boy on 2024-10-01 08:42:53.

I just read a bit, and watched some yt videos about solar flares, Geomagnetic storms and Carrington event, and I must say that I am concerned about the security of my (and everybody else's) data. How secure is it from such an event? There is supposedly a 10-15% chance that something similar might happen to Earth in the next decade, iirc. Is there a reason for concern? How to defend against it, and to preserve data?

The original post: /r/datahoarder by /u/lackadaisical37 on 2024-10-01 07:18:46.

The original post: /r/datahoarder by /u/BrightEyes1616 on 2024-09-30 17:18:35.

Looking for an easy to use solution to automatically run backups on about 500GB data on Windows to a HDD and cloud that will encrypt, compress, versioning, and other useful backup features. If I can learn how to get this to run smoothly, I may eventually build a NAS to hold my media too but for now this is what I'm thinking:

Full-image and user data backups, which I'll store on a cloud service. Not sure how often I'll run these backups yet, but there generally won't be many changes to my data on a daily basis. I'm already syncing this data between devices as well as backing up to HDD so should never or rarely need to download, just upload.

Image: I'm thinking of using free community Veeam for emergency image backups, basically in case I can't boot up anymore.

Files: Syncovery has caught my eye as a one time purchase for pushing file level backups to multiple places. It also has versioning and encryption etc in one. So I figured I can use it to push my user data file folders and the Veeam image backups to cloud and HDD. Are there better alternatives that have an easy GUI/learning curve?

Cloud storage: Hetzner and Backblaze B2 are recommended a lot on Reddit. Are they suitable for storing small amounts of data? I am also considering a lifetime sub to Pcloud or Koofr. Are they less/more suitable? Are the options straightforward to use?

The original post: /r/datahoarder by /u/nig8mare on 2024-09-30 16:16:55.

Something like a QR code but with way more storage that can be easily printable? Preferably easy to scan also?

The original post: /r/datahoarder by /u/RDFTW on 2024-09-30 15:36:22.

When downloading with Jdownloader my files get very heavily fragmented. We are talking over 95% fragmentation on the entire drive when just 50% of the drive is filles all in one go with no copying files over or anything. I always had max chunks at 1 and max simultaneous downloads at 3.

Any idea why this is happening?

The original post: /r/datahoarder by /u/dolby12345 on 2024-09-30 15:16:08.

Looking to get a 1tb ssd for backups. Mostly Samsung S24+ and S8 tablet. The USB C are 3.2 Gen1. The SSD will need to handle complete backups so 120 gb per session idea.

The 3.2 Gen 1 ports are going to give me 500 or so Mbps r/w at most is my guess. I'm looking for a ssd that'll keep up with alot of data in a short time. I'm understanding TLC is the way to go as the ssd gets full. Less cache issues.

So basically it's all about speed and alot of data without bogging down for archiving. Recommendations? So far I'm looking at the Crucial x9pro.

Open to feedback if my facts are wrong. I'll be using 10 Gbps cables, Gen2.

The original post: /r/datahoarder by /u/saschafiedler on 2024-09-30 15:02:52.

Hello everyone,

I'm new to the NAS game and looking for a solution for video editing and storage.

We have an editor who needs to be able to edit videos on the NAS. There are also four people who occasionally, but never at the same time, need to be able to access the storage to view video files.

I am thinking of a DS923+ with a 10Gb network card. The editor would be connected directly to the NAS via a Thunderbolt adapter and everyone else would be connected via the company network, which is limited to 1Gb. Can the NAS be configured accordingly and will I achieve my goal?

For storage I was thinking of 3x 12TB HDDs in RAID5 and 500GB SSD as cache. Is it better to configure the cache as RAID0? Is it even necessary for our application?

Bonus question: should we also look at a QNAP TVS-472XT to give the editor a native Thunderbolt connection with a theoretical 40Gb?

Thank you!

The original post: /r/datahoarder by /u/N2-Ainz on 2024-09-30 14:44:39.

Hey guys,

I am currently looking for refurbished devices and found a couple of websites. People recommended iuppiter or datablocks for the EU market. While I searched through a couple different topics, I saw someone recommending East Digital. Their pricing looks actually pretty good and they come with a 3 year warranty. Is this site a trusted site?

Link: https://east-digital.myshopify.com/

The original post: /r/datahoarder by /u/Toranton on 2024-09-30 14:20:26.

Is there a browser add-in or other solution to save images on-the-go while browsing?

I tried multiple Image Downloader add-ins, but they didn't really work because the page has a feature that lets you see more content when you get to the bottom. However, after about 10 minutes of scrolling, the image paths lose their validity and the add-in only downloads the images from the last 10 minutes. Therefore I am looking for a way to save everything during the call.

The original post: /r/datahoarder by /u/Typical-Yogurt-1992 on 2024-09-30 13:52:38.

These are the "characters prohibited by Windows" that I mean.

| Character | Name | |

|

| | < | less than | | > | greater than | | : | colon | | " | speech marks | | / | forward slash | | \ | backslash | | | | | ? | question mark | | * | asterisk |

If I remember correctly most of these characters should be available on MacOS. If you normally use a Mac and your external SSD contains these characters, How are these files recognized by Windows OS?

The original post: /r/datahoarder by /u/yokingato on 2024-09-30 13:05:19.

https://www.theverge.com/2024/9/24/24253376/nyt-podcast-paywall-spotify-apple

I'd love any advice on this. I don't have a lot of storage, but I'd really love to keep these somewhere, if that's possible.

Thank you!

The original post: /r/datahoarder by /u/TW-Twisti on 2024-09-30 12:32:59.

One thing I keep stumbling over is how to manage my collection of stuff. In-app solutions like Plex or Jellyfin are fine-ish, but I don't typically have my entire collection on my media server at once, and I am missing a feature to add shows or movies that I have no files for so I can (down) rate them in order to signal that I looked into them and decided not to get/keep it.

Any advice/ideas ?

The original post: /r/datahoarder by /u/szaimen on 2024-09-30 12:26:48.

Join the Nextcloud AIO Project: Contribute to a Unified Cloud Experience

Are you passionate about Nextcloud and collaboration? Do you want to contribute to a cutting-edge open-source project?

The Nextcloud AIO (All-in-One) project is seeking contributors from around the world to help shape the future of collaboration platforms.

What does the project aim to achieve?

Our goal is to create a unified, all-in-one cloud solution that integrates multiple services and applications under one roof. This way users can easily use all the tools and features from Nextcloud.

How can you contribute?

As a contributor to the Nextcloud AIO project, you can help us achieve our goals by contributing your skills, expertise, and time. Whether you're a developer, designer, documentation writer or tester, we welcome your participation and look forward to collaborating with you!

Get involved today!

If you're interested in joining the Nextcloud AIO project as a contributor, please visit the following link to learn more about how to get started.

https://github.com/nextcloud/all-in-one/issues/5251

Thank you for considering contributing to the Nextcloud AIO project. We look forward to welcoming you to our community!

The original post: /r/datahoarder by /u/lil_killa1 on 2024-09-30 09:59:40.

The original post: /r/datahoarder by /u/CONSOLE_LOAD_LETTER on 2024-09-30 08:19:38.

I've found there are three major components to my data hoarding hobby.

1. Hardware: including cheap deal acquisition, configuration, and maintenance
2. Data acquisition: including hunting/exploring/researching interesting things and then finding efficient ways to obtain and digitize them
3. Curation: organizing all the data and making it easy to find and enjoyable or meaningful to access

My time split currently is about 10% hardware / 60% data acquisition / 30 % curation. Of these, I find data acquisition to probably be the most stimulating and ejoyable part, and curation to often be tedious but also the most important and satisfying part once it starts coming together. Curation also tends to lead towards researching and uncovering more data to acquire, and then that sort of becomes an ever expanding loop.

Sometimes though I feel I need to reduce the amount of time I spend on data acquisition so I can focus on curation and actually putting the data to good use, as the ever mounting backlog of unorganized hordes far outpaces my ability to curate them meaningfully. What good is the data if it is never organized in an accessible manner or ever used? It can be difficult psychologically though because sometimes I get to thinking "what if it disappears?" and then I get distracted back into acquisition mode and lose focus on my curation goals.

Anyways, I was just curious if others here ponder this kind of stuff and maybe have different ways of thinking or going about things.

The original post: /r/datahoarder by /u/Swatieson on 2024-09-30 07:51:28.

The original post: /r/datahoarder by /u/iced_maggot on 2024-09-30 07:03:22.

Hey all, have done a bit of searching on this and am unable to find a definitive answer so I'm hoping someone here can help. I am in the process of upgrading my hoarder set up and transitioning to a Dell T330 tower server. The server comes with a 8x3.5" drives with a back plane that connects to a Dell H330 card via MiniSAS 8087.

Does anyone know if the backplane from these older Dell tower servers can plug and play handle newer HGST / WD drives which have Power Disable / PWDIS feature? Thanks.

The original post: /r/datahoarder by /u/deleted-shaow on 2024-09-30 06:36:34.