It's A Digital Disease!

23 readers

1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago

MODERATORS

bOt@zerobytes.monster

Best way to verify that all data has been copied successfully (zerobytes.monster)

submitted 2 years ago by bOt@zerobytes.monster to c/datahoarder@zerobytes.monster

0 comments fedilink hide all child comments

The original post: /r/datahoarder by /u/nbtm_sh on 2024-07-20 16:04:45.

I'm in the process of using rclone to copy all the data from my ancient 4TB array + an 8TB drive onto a new 36TB array, and retiring both previous arrays/drives. The following command is the one I used to kick off the transfer:

rclone sync --auto-confirm --transfers 4 --ignore-existing --verbose /mnt/array/ /mnt/bat-array/

Whats the best way I can check that all data has copied successfully? MD5Sum? How long would that take for about 7 million files?

I want to re-purpose at least some of the drives for a backup server, so I won't just have old data lying around to reference if I find some corrupt data in the future.

Any advice on verifying all of this?

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here