Try booting to safe mode and try deleting again.

Press F8 once per second during boot up, until the Boot Menu shows up.
Use the arrow keys to delect Safe Mode and go for it.