Microsoft does not have a version of Windows that installs to and runs from USB external drives.

Linux does. Is Linux an option?
Bob