String.Trim() removes more than need?

Question

I found a ticket in our issue tracker that one of customers report a bug that one texts is incomplete! We have a text conversion program from one legacy system(IBM AS400) to a modern one. I tracked it and found an unknown behavior on my code!!

First see this:

As you see, there is two char before first space (char32), but when i remove Trim(),the result is:

Yes, Trim() removes char160 from beginning! What happened that Trim() works more than need? Note: both pictures are captured in same test state.

Answer 1

160 is a NBSP (Non-breaking space) and according to the documentation, Trim will remove all the whitespace. 160 is classified in Unicode as whitespace.

You might want to call Trim(' ') instead.

Answer 2

Trim() removes leading and trailing white space characters, and that's excactly what it is supposed to do.

char 160 is a non breaking space, which is one of the white space characters it eliminates.

Answer 3

Trim removes all white-space, not just spaces. If char 160 is a whitespace in code page 1256, Trim will remove it.

The following code shows that 32 and 160 are whitespace in codepage 1256:

        var chars = new byte[] {32,160,164 };
        var enc=Encoding.GetEncoding(1256);
        var str=enc.GetString(chars);
        foreach (var character in str)
        {
            Console.WriteLine("{0}:{1}", character, Char.IsWhiteSpace(character));
        }
        Console.ReadKey();

Returns:

       True
       True
       False