First of all, thank you so much for your responses to my question!
I presented them to my colleagues and now half of them are using Jeff's and the other half Richie's solution.
Jeff's solution is, as pointed out by @Dubu, stable across different file systems, works with backups and is portable to other operating systems. Moreover, the solution is fast and easy to accomblish for everyone.
Now, let's assume you are using LaTeX for writing your thesis, then you will use similiar lines of code to insert your sections:
\input{./03_Section_A/Section_A.tex}
\input{./04_Section_B/Section_B.tex}
Let's also assume that you make the decision to add a new section, which should come between two existing sections (here between 03 and 04). Which changes are needed to add the new section in the sequence of folders?
Using Jeff's solution, you need to rename all existing folders and adjust all paths in your LaTeX file accordingly:
\input{./03_Section_A/Section_A.tex}
\input{./04_NewSection/NewSection.tex}
\input{./05_Section_B/Section_B.tex}
Here, Richie's solution comes in handy.
In fact, you do not need numbers in front of folder names anymore.
If you make the decision to add a new section, which should come between two existing sections, you just need to update the desktop.ini files.
Any adjustments in the LaTeX file, besides inserting the new section, is not needed.
\input{./SectionName_A/Section_A.tex}
\input{./NewSection/NewSection.tex}
\input{./SectionName_B/Section_B.tex}
To sum up, it is a personal decision to use Jeff's or Richie's solution.
Both of them are great.