So, this means they either have a local copy on disk of whatever database they're querying, or they're dumping a remote db to disk at some point before/during/after their query, right?

Either way, I have just one question - why?

Edit: found the thread with a more in-depth explanation elsewhere in the thread: https://xcancel.com/DataRepublican/status/1900593377370087648#m

So yeah, she's apparently toting around an external hard drive with a copy of the "multiple terabytes" large US spending database, running queries against it, then dumping the 60k-row result set to CSV for further processing.

I'm still confused at what point the external drive overheats, even if she is doing all this in a "hot humid" hotel room that she can't run any fans I guess because her kids were asleep?

But like, all of that just adds more questions, and doesn't really answer the first one - why?

[–] GoodEye8@lemm.ee 24 points 5 months ago (9 children)

My one question would be "How?"

What the hell are you doing that your hard drives are overheating? How do you even know it's overheating as I'm like 90% certain hard drives (except NVMe if we're being liberal with the meaning of hard drive) don't even have temperature sensors?

The only conclusion I can come to is that everything he's saying is just bullshit.

[–] carpelbridgesyndrome@sh.itjust.works 8 points 5 months ago (6 children)

Hard drives do get hot and need some cooling but not at 60k rows. Its either made up or their computer case is made of thermal cladding

[–] xthexder@l.sw0.com 9 points 5 months ago* (last edited 5 months ago) (1 children)

Imo if they can't max out their harddrive for at least 24 hours without it breaking, their computer was already broken. They just didn't know it yet.

Any reasonable SSD would just throttle if it was getting too hot, and I've never heard of a HDD overheating on its own, only if there's some external heat sources, like running it in a 60°C room

[–] T156@lemmy.world 1 points 5 months ago

Hard Drives might do it if the enclosure is poorly designed (no ventilation), but I can't imagine a situation where it would overheat like that that quickly, even in a sealed box. 30k is nothing in database terms, and if their query was that heavy, it would bottleneck on the CPU, and barely heat the drive at all.

load more comments (4 replies)

load more comments (6 replies)

load more comments (23 replies)