Skip to main content

All Questions

Tagged with
18 votes
5 answers
13k views

Is there a way to access files from one WSL 2 distro/image in another one?

I have several Unbuntu WSL 2 "installations" on my Windows 10 system and I'd like to be able to run tools like rsync and diff between them. Is it possible to mount/find where the files for ...
intel_chris's user avatar
4 votes
2 answers
11k views

Best way to compare two very large directories in Linux

I need to compare two directories on Linux filesystems on two separate servers in order to identify whether all the files from SERVER1 are present on SERVER2. The total data set is about 4TB of files ...
btongeorge's user avatar
5 votes
1 answer
4k views

Ignore line endings when using Rsync

I want to sync two directories. The first one has CRLF and normal line endings, the second directory also has files with CRLF and normal line endings. The problem is, when I execute this code: ...
Sergio's user avatar
  • 153
-1 votes
1 answer
664 views

diff says files are different even after sync with rsync

To synchronise two directories, I run diff -r -q path/to/dir1 path/to/dir2 1>/dev/null if [[ $? == "0" ]] then echo "Directories are exact copies of each other" else rsync -av --delete path/to/...
Narusan's user avatar
  • 101
1 vote
3 answers
748 views

How can I quickly compare two directories skipping hard linked files that exist in both directories in linux

I have two directories that I would like to compare. The first directory contains an rsync backup of many thousands of folders and files. The second directory contains hard links to all of the files ...
decuser's user avatar
  • 229
12 votes
3 answers
32k views

How do I compare two folders recursively and generate a list of files and folders that are different?

tl;dr and an example I'm looking for a way to compare two folders recursively and output the relative paths all files (and folders) that are different (by size or by timestamp, à la rsync). For ...
Andrew Cheong's user avatar
2 votes
1 answer
3k views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
d0g's user avatar
  • 2,300
60 votes
7 answers
91k views

How to print files that would have been changed using rsync?

Is there a way to get rsync to print the full filepaths to all files that are different without actually transferring any files? Alternatively, I need a way to diff the files across two trees (over ...
Joe Tsai's user avatar
  • 609
3 votes
1 answer
2k views

How to create Delta / Changed files from directories?

I'm trying to create a "changed files" package from one directory to another and need to find a Linux/Unix tool/utility that will be able to handle this. Example: Package_1.1/ (old) Package_1.2/ (...
Highway of Life's user avatar
1 vote
1 answer
237 views

Check for duplicate files in two collections, ignoring duplicates within A

I have four similar large collections of website files. They are archived copies of a similar directory tree from different times in the past. I want to merge them all to the most recent collection, ...
nimasmi's user avatar
  • 133