Isn't it supposed to? My compaq's battery light stays on whenever the machine's plugged in, whether it was on or not. I don't think you're supposed to get troubled over that.
Sorry i meant once its switched off and with the power supply taken out, so just running on battery. it stays orange the whole time unless you take the battery out.