The wall wart does have a second or more of power so you'll have to cut power for long enough for it to use that up.

If it fails to restart even when given enough time, then it's time to swap it for some other model that does what you want. (almost any other model!)
Bob