30

I have some 500 files of 650MB each, named bigfile.000 to bigfile.199 and I need to calculate the MD5 checksum of all files combined. The command I am using is:

cat bigfile.* | md5sum

I have the time, and I understand it will take hours to complete, but I still want to check the progress. Is there any way to do so? Like piping something in between and do a word count that doesn't affect performance much?

Seth
  • 59,332
Kenneth L
  • 917

2 Answers2

38

Use pv. It is in the repos, and shows a nice progress bar. 

pv bigfile.* | md5sum

should do what you want.

Seth
  • 59,332
Jos
  • 30,529
  • 8
  • 89
  • 96
5

Progress bar plus stats: ETA, ...:

pv -pteIrabT file | md5sum

For example:

# pv -pteIrabT hugefile.tar.lzo | sha1sum 
7.59GiB {----} 0:03:22 [39.1MiB/s] [38.5MiB/s] [>                          ]  7% ETA 0:41:47 ETA 19:45:26
Pablo Catalina
  • 51