I can think of a few immediate causes involving the power supply.  You got a lemon and the fan isn't working properly and overheats.  Another possibility is that your PC is trying to pull more power than what your PSU can supply.  How many watts is the new PSU?