Researchers at the University of Montreal say they have developed techniques that enable computer cursors to interact in 3D in single or multiuser, local or remote collaboration scenarios.

The system, unveiled at the SIGGRAPH 2015 Conference in Los Angeles, is not so much about turning Word into an IMAX experience as offering designers an opportunity to navigate through and modify their creations manipulating 3D objects with 3D interactions.

"Our new technology challenges the notion of what a cursor is and does," says lead researcher Professor Tomás Dorta, of the university's School of Design. "The cursor becomes a drawing and controlling plane." The techniques involve using a tablet to control the cursor, but as it does not necessarily rely on external tracking of the user's movements. With time, other devices could be used, such as smart phones or watches.

The researchers use a butterfly-net analogy to explain how the cursor selects objects in space; users simply sweep the 3D cursors through, Dorta says.

"For the manipulations of objects, the users can use gestures and movements such as pinching and orientation." The cursor is being demonstrated within the researchers' Hyve-3D design system, a full scale immersive 3D environment that enables users to create drawings on hand-held tablets, which can then be manipulated on the tablets to create a 3D design within the space. As the designers are immersed in their work, they can test different options according to the scale.

The immersive images are the result of an optical illusion created by a high-resolution projector, a specially designed 5m-diameter spherically concave fabric screen and a dome mirror projecting the image onto the screen. Specialized techniques render the 3D scene onto a spherical projection in real-time

Univalor, the university's technology commercialization unit, is supporting the market launch of the Hyve-3D system and the 3D cursor, via the startup Hybridlab Inc. Several patents are pending.

"Beyond its utility for sketching, we believe the 3D cursor has applications in a wide range of fields, such as architectural design, medical imaging and of course computer games. This isn't a gimmicky rebirth of the cursor, it's about rethinking how humans interact with computers as part of the creative process," says Dorta.