Skip to main content

All Questions

Tagged with
88 votes
4 answers
76k views

Why is piping 'dd' through gzip so much faster than a direct copy?

I wanted to backup a path from a computer in my network to another computer in the same network over a 100 Mbit/s line. For this I did dd if=/local/path of=/remote/path/in/local/network/backup....
Foo Bar's user avatar
  • 1,500
45 votes
3 answers
129k views

Howto pipe: cp | tar | gzip without creating intermediary files?

Can anyone tell me if it's possible to pipe | this without having to create a physical file anywhere between A and B.tar.gz? This is what I'm trying to do: File A Rename A to B Tar B.tar gzip -9 B....
user avatar
2 votes
1 answer
107 views

Which is better: using flags, or pipes?

As with many things in the *nix world, there is more than one way to generate .tar.gz files. Typically, I use the following: tar zcf /path/to/dir.tar.gz /path/to/dir However, I have seen the ...
warren's user avatar
  • 10.2k
1 vote
2 answers
3k views

Split a large .gz file and gzip each of split file?

I have a large text.gz file (2GB) and I want to split it by line. I tried to use: zcat text.gz | split -l1000000 However this generated a huge file (around 92GB before I terminated it) and put too ...
yumyai's user avatar
  • 156