I think this problem started when you "cut" files from the Recycle Bin and pasted them to a different folder instead of restoring them from the Recycle Bin to their original folder then moving them from there. The Recycle Bin is an unusual utility in that it isn't really a location, (like a folder). Any files sent to the Recycle Bin are not deleted, but the file information is stored there until the bin is emptied. That's when the files themselves are deleted.
I'm not sure how to get round this, but there is a hidden system folder called "Recycler", which may help you. You will need to use Windows Explorer for this, (note I said Windows Explorer and not Internet Explorer), from Start > All Programs > Accessories > Windows Explorer.
What is displayed is a window with a left pane that lists all locations on your system and a right pane that displays files and sub-folders within any highlighted location in the left pane. The left pane has + and - signs to expand or contract locations.
If there is a + sign next to My Computer click that, then click the + sign next to "Local Disk (C: )".
You next need to display hidden system files. Goto Tools > Folder Options then click the "View" tab. Select, "Show hidden files and folders", then scroll down and de-select "Hide protected operating system files, (recommended)". Whilst you are there I would also de-select "Hide extensions for known file types" if that is selected.
Click Apply then OK. Now, in Windows Explorer in the left hand pane a new folder will appear called "RECYCLER". Highlight that, and in the right hand pane you may see one or two, or more, faint folders. Click or double click these to display the contents. Typically there is one sub-folder for each drive or partition installed on the computer.
You can either delete the contents themselves or delete the Recycler folder itself. If you delete the Recycler folder it will be re-created when you next reboot the computer.
See if that works. It may break the connection between those files you cannot delete and the Recycle Bin.
If you get an Access Denied message, are you running Norton's software, or any other anti-virus which protects the Recycle Bin? If not, try "Taking Ownership" of those files you want to delete by following the guidance here.
Some other resources that may help are here;
I hope that helps.
PS, remember to re-select the folder option to hide system protected files. The others can remain as they are.