They sort of do. When you delete a file, the operating system doesn't actually delete the file, it just marks that part of the disk as free. The files still exist until they are overwritten by something else.
As far as the browser is concerned, they're gone.
I have always wondered if you delete your cookies, temporary files, and internet history do they still stay on your hard drive?