I have some directories with over 100Gb of data. I'm trying to archive them into smaller volumes i.e. 10Gb each that are independent / standalone.
The problem is if I use tar
+ split
, it results in multiple tar parts that are not independent. I cannot just extract files from one of the parts, unless I cat / combine all back into a single large file first.
I've also tried using tar -c -L1000M ...
to split volumes, but that doesn't work either and there's a problem with long filenames getting truncated.
Tried star
as well, but seems like its split volumes are not independent either; while 7zip does not preserve permissions in unix.
The reason I wish to have independent split archives is for safety purposes, in case one of the split files are corrupted, I can still retrieve data from the other archives. It is also much faster if I wish to only extract specific files/folders, without needing to combine all the archives back into a single large volume.
How best do I achieve this? Thank you.
SOLUTION FOUND
I have found a solution using tar, as suggested by @Haxiel's answer. The answer has been posted below.
Note that there may still be a file or two that lost if it crosses the boundary of a volume and you don't have the next volume available, but at least the separate volumes could be independently extracted even if the other parts are missing.