Hmm. What model amplifier is it? Does it have +12v, ground, and remote wires all connected to it? I know some amps have signal sensing to turn them on. There is a possibility that a loose rca cable could be causing some noise and causing it to stay on. It definitely wasn't staying on before, right?