Multipart Consistency issue on macOS
On macOS, a file downloaded through multipart does not appear to have the right ETag, but the file does appear intact. The video file was the right size and it still played fine even though the md5 sum was wrong. On a UMIACS RHEL7 host with umobj installed through RPM I was not able to recreate this problem.
- Python: 2.7
- Platform: macOS Mojave
In the following sequence the correct MD5 sum of the file used is 438506bc2706076990ac423648a27aa6
(env27) hecuba:~ $ cpobj -Vm liam20191203:myvideo.mp4 .
INFO: Finished setting up logging.
INFO: Running ['/Users/liamwork/env27/bin/cpobj', '-Vm', 'liam20191203:myvideo.mp4', '.']
INFO: Download mode with bucket liam20191203.
INFO: Downloading with the key name/prefix myvideo.mp4.
INFO: Downloading to the local directory ..
INFO: Downloading key <Key: liam20191203,myvideo.mp4> (139820571) to .
INFO: Starting a multipart download for bucket liam20191203 and key myvideo.mp4
INFO: myvideo.mp4 : Size: 139820571 Chunk Size: 27075126 Number Chunks: 6
INFO: Starting downloading bytes 0 - 27075125.
INFO: Starting downloading bytes 27075126 - 54150251.
INFO: Starting downloading bytes 54150252 - 81225377.
INFO: Starting downloading bytes 81225378 - 108300503.
INFO: Starting downloading bytes 108300504 - 135375629.
INFO: Starting downloading bytes 135375630 - 139820570.
(env27) hecuba:~ $ md5 myvideo.mp4
MD5 (myvideo.mp4) = ec268a90658a40c0b95042f90c5839b4
(env27) hecuba:~ $ cpobj liam20191203:myvideo.mp4 myvideo_nomulti.mp4
100% |##########################################################################################|
(env27) hecuba:~ $ md5 myvideo_nomulti.mp4
MD5 (myvideo_nomulti.mp4) = 438506bc2706076990ac423648a27aa6
Even though I am reporting this problem on Python 2.7, it still happen on Python 3.6 on macOS as well.