The advice you've had so far seems to have been almost completely the opposite of the facts as I understand them.
The iPod does support folders -- in fact that's its next best feature after the display, not least because it actually saves you having to fuss with tagging.
What iPod doesn't allow you to do is simple drag and drop -- and iTunes, that you are forced to use instead, is one of the worst pieces of software I have encountered (certainly the version for the PC, which breaks basic Windows principals).
Look for an MP3 player which supports folders but also understand that drag and drop is by far the simplest way to manage and transfer your music files. There are other features to consider which apparently rule out the iPod as a choice -- memory expandable by SD card, user replaceable battery, sound quality, purchase cost.
Personally, I'd look at Sansa and Sony models -- not all their models do all of the above but they sound good and are good value.
Hi guys,
I am in need of your world advice.
I am looking for an mp3 player (anything BUT an iPod).
It must have the following specifics:
1. Be able to show me my mp3 player folders as I have them on my PC.
I will forgo hard drive size, size of mp3 player, even price, if it means I can have my pc setup for folders and albums, on my mp3 player.
Can you please tell me which mp3 players do this? I know iPod doesnt allow me this, and I have to edit id3 tag. I dont want to do any editing, drag and drop, plug and play would be great, and to have the exact same file structure.
Any ideas?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic