3D VIEW: Designing of a Deception from Distorted View-dependent Images and Explaining interaction with virtual World
This paper presents an intuitive and interactive computer simulated augmented reality interface that gives the illusion of a 3D immersive environment. The projector displays a rendered virtual scene on a flat 2D surface (floor or table) based on the user’s viewpoint to create a head coupled perspective. The projected image is view-dependent which changes and deforms relative to user’s position in space. The nature of perspective projection is distorted and anamorphic such that the deformations in the image give an illusion of a virtual three-dimensional holographic scene in which the objects are popping out or floating above the projection plane like real 3D objects. Also, the user can manipulate and interact with 3D objects in a virtual environment by controlling the position and orientation of 3D models, interacting with GUI incorporated in virtual scene and can view, move, manipulate and observe the details of objects from any angle naturally by using his hands. The head and hand tracking are achieved by a low-cost 3D depth sensor ‘Kinect’. We describe the implementation of the system in OpenGL and Unity3D game engine. Stereoscopic 3D along with other enhancements are also introduced which further improves the 3D perception. The approach does not require head-mounted displays or expensive 3D hologram projectors as it is based on perspective projection technique. Our experiments show the potential of the system providing users with a powerful, realistic illusion of 3D.
 MacKenzie, I. S., & Ware, C. (1993, May). Lag as a determinant of human performance in interactive systems. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems (pp. 488-493). ACM.
 Rekimoto, J. (1995, March). A vision-based head tracker for fish tank virtual reality-VR without head gear. In Virtual Reality Annual International Symposium, 1995. Proceedings. (pp. 94-100). IEEE.
 Lee, J. (2007). Head tracking for desktop VR displays using the Wii remote. Published online at http://www. cs. cmu. edu/johnny/projects/wii.
 Cruz-Neira, C., Sandin, D. J., & DeFanti, T. A. (1993, September). Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In Proceedings of the 20th annual conference on Computer graphics and interactive techniques (pp. 135-142). ACM.
 OpenNI Framework, Available online at http://www.openni.org.
 NITE Middleware, Available online at http://www.primesense.com/solutions/nitemiddleware.
 Official OpenGL website, http://www.opengl.org.
 Official Unity3D website, http://unity3d.com.
 Lee, Johnny Chung. "Hacking the nintendowii remote." IEEE pervasive computing 7, no. 3 (2008).
 TrackIR – Premium head tracking for gaming, official website http://www.naturalpoint.com/trackir.
 FaceAPI from Seeing Machines, Available online at http://www.seeingmachines.com/product/faceapi.
 Parvizi, E., & Wu, Q. J. (2007, October). Real-time 3d head tracking based on time-of-flight depth sensor. In Tools with Artificial Intelligence, 2007. ICTAI 2007. 19th IEEE International Conference on (Vol. 1, pp. 517-521). IEEE.
 Gokturk, S. B., & Tomasi, C. (2004, July). 3D head tracking based on recognition and interpolation using a time-of-flight depth sensor. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on (Vol. 2, pp. II-II). IEEE.