Olympus and Fujifilm use different methods of using manual settings.
I suggest you go to Page 43 of your Owners Manual and read.
Especially read the last paragraph of the page.
You may need to press the shutter button half-way down to see the change you made.

..