I'm guessing the files with .mp3 icons are .mp3 files? And the artwork has a different file extension? If so, then Windows identifies each file extension with a different icon.. That is as designed and you don't want to change that.. Windows may not recognize exactly what type of file you've got and therefore not play it correctly.. In addition, if you simply change the icon of all .mp3 files, then you won't know other types of .mp3 files which play in your media players..
On the other hand, if the file extensions for both icons are the same, then you may have a problem. Please let us know.
Hope this helps.
Some of the icons in my music folder are the album artwork for the song. Most of the icons are a generic mp3 icon. Can anyone tell me how to make all the icons album art? All songs have album art when played in media player.