It's a very common problem with LCDs in general, and for whatever reason, the PSP in particular.
You can try taking it back to Walmart with some bogus excuse about it not working. So long as you're just looking to exchange items, stores are usually pretty willing to buy any excuse. They just send the defective units back to the manufacturer for a refund themselves.
Thing is, it's highly unlikely you'll ever get a PSP that doesn't develop a dead or stuck pixel over time. So, you can take your chances that your current unit won't develop any more pixel problems, or gamble on a new unit not having even more dead/stuck pixels, or being prone to developing them. You can also buy replacement displays if you're willing to tear the PSP apart.
Only thing I can suggest, is sometimes holding the unit at a slightly different angle will make the pixel less noticeable. Other than that, it gradually becomes like those black bars on some TV shows... At first they're really annoying, but eventually you learn to just ignore them.
Sorry though, guess that's one drawback I forgot to mention about the PSP. I wonder if Sony didn't just use some cheap LCD unit they knew was prone to failure. Doesn't seem so far fetched after it came to light all those exploding laptop batteries were made by Sony, and that they knew about the problem something like a year before it broke in the press, and had done nothing. Also makes me wonder if the display being some cheap unit has anything to do with why I find it so hard to look at. Anyway, sad to say you're now a member of a club no one wants to be part of.
Okay, so I finally got my PSP and opened it today. I was really exicted, charged it up, waited and waited. The first thing I did was check for a dead pixel cause I've heard this is a pretty common problem, didn't see anything, was really happy.
I started playing again later tonight and was watching the screen more closely because I wasn't doing something else at the same time. Well, I noticed when there was a completely black screen (while it was starting a game up) way up in the top of the screen, almost mid-screen, one little tiny dot was lit, everything else was black. So, I checked with the different theme colors and it did the same thing on a few of the darker colors. I am assuming this is what the dead pixel is.
I've been thinking about it, I only have one game right now, a racing game, and one UMD movie. So, in my racing game I don't really notice the pixel and I would think in most games I wouldn't. But, I'm concerned it may bug me a little when I'm watching movies (I tend to be a person that can miss everything that is perfect and concentrate only on the one little problem).....
But, how big of a problem is the dead pixels? I would hate to get one that ends up being worse. If I take it back, am I likely to have the same problem?
Another thing I wasn't to sure of is if this is only a problem that you will have from the start, or if it is something that can develop over time? I didn't notice it at first, so I'm a little worried they are all going to start doing it.
In the packaging it says not to return to the store, I bought it at Wal-Mart. But, I really don't want to have to wait on Sony to ship me a new one or fix or anything like that, can Wal-Mart replace it for me?
Finally, I also noticed once and a while that I can hear like a spinning noise or something with the UMD. Is this normal? I don't seem to notice it all the time, just once and a while.
Sorry for all the questions.
Thanks!

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic