1] Does this Office 2003 include the Publisher application? It is a retail optional extra when you purchase Office.
2] Another thought. Did this new Windows 7 arrive with a "Trial period" version of Office 2007 installed as part of the OEM package? If so the general advice is to uninstall all trial versions before installing retail versions.
If the answer to 1 is Yes, and the answer to 2 is No, then when you try to "Open with", can you 'Browse' to the Publisher executable file?
Mark
I recently bought a new computer with Windows 7 x64 and installed my Office 2003 and SP3. Saved Publisher docs appear to be stuck in Word (and the "W" icon is different). Any Publisher docs I try to open attempt to open as Word and come up gibberish. I have attempted to correct the association and "open with" but Publisher is not listed as an option. Any ideas???

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic