All Questions
7
questions
0
votes
0
answers
540
views
gz file corrupted while transfer
I have huge gz files generated in linux machines and everyday night there is a script running to move files to remote network storage which is also linux host with terabytes data. The problem is, I am ...
0
votes
1
answer
248
views
rsync: gzip on source tolerant
I need to transfer a couple of log-files each hour to a logstorage which all users can reach, and I use rsync for do that, but the problem comes when the log-file is rotated and automatically zipped, ...
user290942
5
votes
2
answers
5k
views
Caveats with gzip --rsyncable - no speedup
I am using (trying) gzip to compress an SQL file in an rsyncable way in order to transfer the backup with minimal delay.
However it appears that this is not working, since the speedup is always 1.00.
...
- 3,072
0
votes
3
answers
1k
views
What are good compression algorithms for delta synchronization?
When syncing large files over a slow link, it is often useful to use delta compression in order to reduce the bandwidth used. It is also useful to compress files as they take up much less space.
...
- 1,514
12
votes
3
answers
19k
views
How to gzip a directory, transfer via scp, and decompress in one command?
I frequently transfer large directories over scp and it would be sweet if I could somehow compress the directory, send it, and decompress it all in one.
Is something like this possible?
- 6,325
4
votes
2
answers
1k
views
Is it more efficient to rsync uncompressed text data or the same data gzipped?
Rsync only copies over the changed parts of a file. So if I have a large data dump, for example a SQL database in text format, and I want to copy it to my local machine using as little bandwidth as ...
- 183
35
votes
5
answers
25k
views
Rsync friendly gzip
I must not be the only one - I'm rsyncing .tar.gz files and notice that every time the full file gets rsynced rather than the differences. Reading into it it seems back in 1999 someone created an ...
- 3,333