SAVE: Shared Augmented Virtual Environment for Real-Time Mixed Reality Applications

doi:10.1145/3013971.3013979

	SAVE: Shared Augmented Virtual Environment for Real-Time Mixed Reality Applications
	Zhu, Yu1,2 ; Zhu, Kang1,3 ; Fu, Qiang1 ; Chen, Xilin 3; Gong, Huixing 2; Yu, Jingyi1
	2016
会议录名称	PROCEEDINGS VRCAI 2016: 15TH ACM SIGGRAPH CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY
卷号	1
页码	13-21
发表状态	已发表
DOI	10.1145/3013971.3013979
摘要	With head-mounted displays becoming more and more ubiquitous, such headsets are bringing increasingly realistic and immersive experience to the individual users wearing the device. However, other people outside the virtual world are not able to feel or even observe the same vivid virtual environment as the user does. The strong demand of sharing virtual reality experiences among people are hence driving the development of mixed reality (MR) systems that merge real and virtual worlds into the same new environment. In the new world physical and virtual objects exist simultaneously and interact in real time. In this paper we propose Shared Augmented Virtual Environment (SAVE), a mixed reality system that overlays the virtual world with real world objects captured by a Kinect depth camera. We exploit image matting techniques to get the real world data from a green screen background. In the synthetic MR world both real and virtual objects are rendered in real time, where depths from both worlds are handled properly. The advantage of our system is that we connect the virtual and real worlds by a bridge controller mounted on the Kinect. Thereby, we only need to calibrate the whole system once before use. Our results demonstrate that the proposed SAVE system is able to create high quality 1080p live MR footage, enabling the realistic virtual reality experience to be shared among a large number of people at the same time. The proposed method could find potential applications in education, design, entertainment and so on.
关键词	mixed reality augmented virtual environment Kinect bridge controller
出版地	1515 BROADWAY, NEW YORK, NY 10036-9998 USA
会议地点	Zhuhai, China
收录类别	CPCI ; EI
语种	英语
资助项目	ShanghaiTech University[F-0203-15-006]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods
WOS记录号	WOS:000414281600001
出版者	ASSOC COMPUTING MACHINERY
EI入藏号	20170403268188
EI主题词	Display devices ; Helmet mounted displays ; Interactive computer graphics
EI分类号	Computer Peripheral Equipment:722.2 ; Computer Software, Data Handling and Applications:723 ; Computer Applications:723.5
原始文献类型	Proceedings Paper
引用统计	正在获取...
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/10062
专题	信息科学与技术学院信息科学与技术学院_PI研究组_虞晶怡组信息科学与技术学院_硕士生
通讯作者	Yu, Jingyi
作者单位	1.ShanghaiTech Univ, Shanghai, Peoples R China 2.Chinese Acad Sci, Shanghai Inst Tech Phys, Shanghai, Peoples R China 3.Chinese Acad Sci, lnst Comp Technol, Shanghai, Peoples R China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Zhu, Yu,Zhu, Kang,Fu, Qiang,et al. SAVE: Shared Augmented Virtual Environment for Real-Time Mixed Reality Applications[C]. 1515 BROADWAY, NEW YORK, NY 10036-9998 USA:ASSOC COMPUTING MACHINERY,2016:13-21.