zip-files are just plain normal ordinary files, which happen to have a zip-extension, not doc or txt or exe.

So delete them the same way as you would delete any file. In Explorer select the file (single click), then press del if you want to save them in the recycle bin, or shift-del if you want them totally removed immediately.

Am I missing something?