Ever wondered how some of your mp3 files show up with pictures from your collection  instead of the album art picture or the standard mp3 icon, when browsing through the mp3 collection on hard disk? Also, does the cover image appear at the background when playing an mp3 file using Windows Media Player or any other music player?
1.Thumbnail image of the mp3 files as seen in Windows Explorer (photo).
The thumbnail image can come from JPG album art images (super-hidden) within that folder, or from pictures embedded into each mp3 file. If you need to remove the mp3 album art/images for some reason, first configure Windows Explorer to show hidden and protected Operating System files. Use these steps:
Press WinKey + R to launch the Run dialog. Type
control folders and hit {ENTER}
Click the View tab
Enable Show hidden files, folders, and drives
Uncheck Hide protected operating system files (Recommended)
Click OK.
Open the folder that contains the mp3 album, and delete the AlbumArt_{ GUID }_Large.jpg, AlbumArt_{ GUID }_Small.jpg and Folder.jpg images.
Now if the method above prove abortive, I will recommend you download a freeware application called "Mp3 tag". Check Google for more details.
Source: Me
Cc: Maleeq, skydancer.

Good tutorial. Well done