Research & Development
The Free-viewpoint Immersive Networked Experience (FINE) is researching and developing the concept of live free-viewpoint content which will allow remote viewers to place a virtual camera in a real live-action scene and move it freely in space and time, heightening the sense of presence and reality. I’ve seen several examples of this over the last few years but it seems like this type of viewer control is closer than ever. I can imagine in a teaching and learning environment, allowing students to explore different viewpoints of media content.
Kenziko Kontact is a companion product to to the real time 3D broadcast graphics application VizRT. It allows you to create macros to allow someone to manipulate and annotate inside a 3D CGI environment in real time. You can create different types of icons and graphics tool giving the broadcaster (or in our case the instructor or presenter) a simple to use interface. While this is for broadcast, I can absolutely see applications in teaching – maybe engineering or medical instruction – being able to interact with a model with simple tools – assuming you have the developers to create the application.
Qualcomm was showing their Vuforia technology in the Verizon booth. The picture above shows someone using an iphone to capture the game card on the table. When the camera saw the card, it started a game which was overlayed on the game piece to allow the user to “shoot baskets”. Vuforia’s computer vision functionality will recognize a variety of 2D and 3D visual targets. With support for iOS, Android, and Unity 3D, Vuforia will allow you to write a single native app that can reach over 400 models of smartphones and tablets.
The research engineers at the National Institute of Information and Communications Technology in Japan have integrated 3D visual, touch, sound and even smell into a multi-sensory interaction system experiment. Although there is no real object, you can see it, touch it by using a force feedback pen, hear it, and even smell it simulating real interaction. You can interactively experience the tactile sense of soft 3D virtual balloons and break them with the explosive sound and smell. It was quite impressive.
Here’s the previous version (not the balloon, but you can get the idea)