Spoiler
One method is to drill out the spot welds, remove the mount, then drill holed through the panel and screw in my joystick from the top of the panel. Won't look great but it should do the trick.
One issue with that though is the joystick would be higher, because it wouldn't have the 1cm or so of space that the old mount has. Anybody know if that would feel off in any way?