It sounds like the Play/Record switch is flakey.

If you can, take it back and get a replacement.

...
..
.