Try to inspect and replace the capacitors.
Replace Power Supply with known good.
Without knowing why or how it is unstable, we can't even try to suggest how to fix it.
Since it's a non-critical server for you, you could hack in a standard ATX supply. See Can I replace my 4U server PSU with a desktop PSU?Can I replace my 4U server PSU with a desktop PSU?