To move a folder or selected files I use the other method of copy and paste.

Once the files and/or folders are highlighted then I can press Control+C. now I click once in the target folder and press Control+V. This method avoids any accidental drops along the way.