Ways I tried to implement mode changes a) Use camera to recognize tool used to interact. Did that with QRCodes, it works, but it is horribly slow. b) Use build-in hardware buttons. No chance, this only works in natie apps :(