I don't believe that is an option in WMP, but you can edit out silence between tracks in wave editor software, such as Nero Wave Editor or Goldwave (shareware).
You can download and try Goldwave from http://www.goldwave.com