The area of memory areas on Android has thousands of discussions which is proof there's an issue here. That is while I have a background that covers designs that have memory areas and am at a office full of Android programmers the average Joe/Jane would burn at what it takes to explore and then control such.
OK, I really like ES File Explorer to look around.
But you asked for a lot more and I fear Android is not making this easy or maybe impossible. Beyond that you are asking for apps such as the Gallery to be fixed. I like that one and hope Google and Samsung will offer more about that.
For now I suggest you forget Gallery if it fails. And my feeling about all this? "Android is the new Windows."
Bob
The storage on my phone shows the following;
System storage 1.09GB/1.97GB
SD card 2.07GB/7.38GB
USB storage fully used.
My photos & videos are stored on memory card. I don't have any songs stored.
Although the default storage for photos is the memory card, when I delete photos the USB memory gets cleared & when the USB memory's used up I can't save anything or open the Gallery although I have space on the SD card.
All downloaded apps are on the SD card.
I've reformatted the SD card & also rebooted the phone several times.
How can I make sure my SD card is used to store stuff on & also find out what exactly is stored on USB storage?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic