Skip to main content
Ask Different

Return to Answer

added 43 characters in body
Source Link
Graham Miln
Graham Miln
  • 44.1k
  • 8
  • 91
  • 126

Limited by Storage

Copying files is Input/Output (I/O) bound. This means the copy can only go as fast as the reading or writing of the data. Another limit will be the bandwidth within the computer's bus or the interface the data is being sent over, such as USB, ethernet, or wireless.

Multi-threading or using a faster processprocessor will not significantly reduce copying times. Once the maximum I/O limits of the storage device are reached, increasing the threads or processing power will do nothing; it may even slow the copy due to the administrative overhead.

rsync

rsync - reliably copying thousands of files

On macOS, a reliable tool for copying thousands of small files and folders is rsync (Remote Synchronisation). rsync is included with macOS, so there is no third party software to download and install.

rsync has the ability to compress and decompress data on the fly and can deal with partial copies.

See Fastest and safest way to copy massive data from one external drive to another for a related question about how to copy massive amounts of data.

Limited by Storage

Copying files is Input/Output (I/O) bound. This means the copy can only go as fast as the reading or writing of the data. Another limit will be the bandwidth within the computer's bus or the interface the data is being sent over, such as USB, ethernet, or wireless.

Multi-threading or using a faster process will not significantly reduce copying times. Once the maximum I/O limits of the storage device are reached, increasing the threads or processing power will do nothing; it may even slow the copy due to the administrative overhead.

rsync

On macOS, a reliable tool for copying thousands of small files and folders is rsync (Remote Synchronisation). rsync is included with macOS, so there is no third party software to download and install.

rsync has the ability to compress and decompress data on the fly and can deal with partial copies.

See Fastest and safest way to copy massive data from one external drive to another for a related question about how to copy massive amounts of data.

Limited by Storage

Copying files is Input/Output (I/O) bound. This means the copy can only go as fast as the reading or writing of the data. Another limit will be the bandwidth within the computer's bus or the interface the data is being sent over, such as USB, ethernet, or wireless.

Multi-threading or using a faster processor will not significantly reduce copying times. Once the maximum I/O limits of the storage device are reached, increasing the threads or processing power will do nothing; it may even slow the copy due to the administrative overhead.

rsync - reliably copying thousands of files

On macOS, a reliable tool for copying thousands of small files and folders is rsync (Remote Synchronisation). rsync is included with macOS, so there is no third party software to download and install.

rsync has the ability to compress and decompress data on the fly and can deal with partial copies.

See Fastest and safest way to copy massive data from one external drive to another for a related question about how to copy massive amounts of data.

Source Link
Graham Miln
Graham Miln
  • 44.1k
  • 8
  • 91
  • 126

Limited by Storage

Copying files is Input/Output (I/O) bound. This means the copy can only go as fast as the reading or writing of the data. Another limit will be the bandwidth within the computer's bus or the interface the data is being sent over, such as USB, ethernet, or wireless.

Multi-threading or using a faster process will not significantly reduce copying times. Once the maximum I/O limits of the storage device are reached, increasing the threads or processing power will do nothing; it may even slow the copy due to the administrative overhead.

rsync

On macOS, a reliable tool for copying thousands of small files and folders is rsync (Remote Synchronisation). rsync is included with macOS, so there is no third party software to download and install.

rsync has the ability to compress and decompress data on the fly and can deal with partial copies.

See Fastest and safest way to copy massive data from one external drive to another for a related question about how to copy massive amounts of data.