could be a damaged PSU, try another one
Wouldn't the LEDs be off in case of a broken PSU?
No, In a "low voltage" situation the leds will light, but the voltage is too low for the rest of the circuitry. Your's has the exact same symtoms that mine had when my power supply failed.