And if you need an amp, it's just what you suspect. "Headphone amplifier."
http://www.amazon.com/gp/bestsellers/electronics/280341/ref=pd_zg_hrsr_e_1_4_last finds folk like quite few convertors.
Bob
I like to use headphones when I watch TV late at night.
My old TV had RCA audio out jacks, so I connected to my stereo through those, and I plugged my headphones into that.
Now we just bought an LG42LM6200, which has only a digital audio out jack. What's the best (that is, simplest) option to get headphones connected?
I wouldn't mind an inexpensive soundar if it had an audio out jack I could use, but it's a small room, so I don't really need external speakers. Do soundbars come with audio out?
I see there are digital-to-analog converters for $25 - $30, but do they amplify at all? I'm not an audiophile, but I don't want it to sound like tin can, either.
I've also seen digital wireless headphones, from Sony and others, for like $300 or so, but that's really more than I'd care to spend on any solution, although I could be convinced to splurge if I knew I'd be happy with the result.
Does anyone have a recommendation?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic