All vertical arcade are wrong orientation.
Mame2003 is OK.
There is no fix. Never will be.
Best you can do is remap controls to kind of work for new orientation.
NOP this is one thing that sucks in Garlic OS.
Mame2003 does not work will all games and also take a long time to load for some reason.