19

I exported results in a text file from a program running on Windows 7, and copied the file on Xubuntu 14.04. In a terminal, I ran dos2unix file.txt, which tells me converting file out_mapqtl.txt to Unix format. However, when I look at the file with less, I still see the Windows end-of-line as ^M, and wc -l returns me "0".

I tried several things described here, but none works. I then opened the file in Vim and did :%s/\r/\r/g as explained there, which worked fine. So any idea why dos2unix didn't work? Would there be a way to avoid opening Vim every time?

3

4 Answers 4

21

I know you have gotten this resolved, but I wanted to add a note for reference, based on some testing I've done.

If less is showing ^M, then like Sybren I suspect it is a MAC style ending (\r), not DOS (\r\n). You can determine that easily using cat:

$ cat -e filename

  • Unix endings (\n) show as $
  • MAC endings (\r) show as ^M (less shows these)
  • DOS\Windows endings (\r\n) show as ^M$ (less does not appear to show these)

Use dos2unix to get rid of the DOS (^M$) endings

Use mac2unix to get rid of the MAC (^M) endings - dos2unix won't get rid of these.

I had a file where I had to use dos2unix and mac2unix to get rid of all the non-Unix endings.

2
  • thanks for this answer, I was stumped running dos2unix, didn't realise the file was using the old mac line endings somehow.
    – Pellet
    Commented May 24, 2017 at 0:08
  • IMO, should be actually the answer. Commented Feb 29 at 13:12
15

\r denotes a carriage return, and on MAC it is used without \n to denote a line break. Are you sure the file is in DOS (\r\n) format and not MAC (\r)?

If VIM really turns out to be the only thing that'll repair your files, you can also invoke it as:

vim somefile.txt +"%s/\r/\r/g" +wq

This will open the file, perform the operation, save it, then quit.

Can you give us an example of the file, so that we can investigate further?

4
  • sorry for the delay of my answer. The file was produced on Windows 7, thus I assume it is in the DOS format. I'm not even sure the program runs on Mac. By the way, the program is called MapQTL. Anyway, my problem is now solved, thanks.
    – tflutre
    Commented May 27, 2014 at 9:36
  • Thanks for letting us know your problem has been solved, and accepting my solution as the answer.
    – dr. Sybren
    Commented Jun 2, 2014 at 12:43
  • hi, what does " %s/\r/\r/g" do ? it looks like sed expression . replace '\r' with "\r"?
    – nathan
    Commented Dec 8, 2016 at 0:26
  • 1
    yup, that's what it does. The % in front applies the expression to all lines in the file. Due to the line-ending-handling magic of VIM, this seemingly useless expression apprarently does something.
    – dr. Sybren
    Commented Dec 11, 2016 at 4:05
2

Try this:

tr -d '\r' < file
0

I have used Notepad++ feature: Edit>EOL Conversions>Unix(LF).

Now export this file to the Unix machine using pscp.exe.

Let me know if that worked for you.

0

Not the answer you're looking for? Browse other questions tagged or ask your own question.