With me (Word 97) it's like this.
If you justify a multi-line paragraph left, right or middle the last shorter line goes with it (also on the left, right or middle).
If you justify a multi-line paragraph both left and right (I'm doing all my justify's with the buttons on the toolbar) the last shorter line goes to the left side and isn't stretched.
A one-line paragraph behaves as the last line of a multi-line paragraph.
The word 'paragraph' is essential. As you surely know you make a paragraph by hitting enter. If you go to a new line by hitting ctrl-enter, every line is justified as instructed. There are no paragraphs then, so the exception for the 'last shorter line of a paragraph' can't be executed.
You can see the difference between a paragraph and a ctrl-enter by setting some checkboxes in Tools>Options>View (show everything).
If this doesn't work as it should in a newly created document, start with deleting normal.dot.
Hope this helps.
Kees
I have an enquiry with word 2000. When I try to Justify text, all the lines, take up the full width of the page i.e. including the lines that only have 1 or 2 words in them. Even the letter heading and the address are stretched over the whole width of the page. I have tried selecting paragraphs individually and then dealing with the rogue lines on their own but they get justified regardless. It's driving me crazy!

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic