Mobile VR Shooter

A tracked handheld controller for phone VR, made from a printed paddle.

Role
Concept and development
Areas
XR, Apps, Computer Vision
Side-by-side stereo VR view of a gun held in a tiled room, with smoke from a shot hitting the wall.

Phone-based VR headsets track where you look, but not your hands. This demo adds a tracked controller with nothing more than a piece of printed cardboard.

The controller is a "fan" paddle, about the size of a ping-pong paddle, printed with a recognition target. With a Google Cardboard-style headset, the phone's camera sees the target and tracks the paddle's position, which becomes the gun in your hand. Rotating the paddle about 90 degrees either way fires.

A four-step flow: a paddle printed with a recognition target, seen by the phone's camera in a Cardboard-style headset, tracked so its position becomes the gun, and rotated about 90 degrees either way to fire.
Phone VR tracks where you look; the printed paddle adds your hand.

Related work: our phone-based AR headset and our Unity tools for phone headsets.

Part of our mobile XR R&D.