Did you try non-amplified headphones? If those work the noise is finding it's way though that USB power jack.
Bob