A shared augmented virtual environment for real-time mixed reality applications

doi:10.1002/cav.1805

	A shared augmented virtual environment for real-time mixed reality applications
	Zhu, Yu1,2,3 ; Li, Shiying2 ; Luo, Xi2 ; Zhu, Kang1,2 ; Fu, Qiang2 ; Chen, Xilin 4; Gong, Huixing 5; Yu, Jingyi2
	2018-09-01
发表期刊	COMPUTER ANIMATION AND VIRTUAL WORLDS (IF:0.9[JCR-2023],1.1[5-Year])
ISSN	1546-4261
卷号	29 期号:5
发表状态	已发表
DOI	10.1002/cav.1805
摘要	Headsets for virtual reality such as head-mounted displays have become ubiquitous and bring immersive experiences to individual users. People who stand outside the virtual world may want to share the same scenes that are shown on the screen of the headset. It is therefore of great importance to merge real and virtual worlds into the same environment, where physical and virtual objects exist simultaneously and interact in real time. We propose shared augmented virtual environment (SAVE), a mixed reality (MR) system that overlays the virtual world with real objects captured by a Kinect depth camera. We refine the depth map and exploit a Graphics Processing Unit (GPU) based natural image matting method to obtain the real objects from cluttered scenes. In the synthetic MR world, we can render real and virtual objects in real time and handle the depth from both worlds properly. The advantage of our system is that we connect the virtual and real worlds with a bridge controller mounted on the Kinect and need to calibrate the whole system only once before use. Our results demonstrate that the proposed SAVE system is able to create high-quality 1080p live MR footage, enabling realistic virtual experiences to be shared among a number of people in potential applications such as education, design, and entertainment.
关键词	calibration Kinect mixed reality natural image matting real time
收录类别	SCI ; SCIE ; EI
语种	英语
资助项目	Science and Technology Commission of Shanghai Municipality[17XD1402900] ; Science and Technology Commission of Shanghai Municipality[17JC1403800]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000446555300001
出版者	WILEY
WOS关键词	IMAGE ; FRAMEWORK ; CAMERA
原始文献类型	Article
引用统计	正在获取...
文献类型	期刊论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/28074
专题	信息科学与技术学院_硕士生信息科学与技术学院_PI研究组_虞晶怡组
通讯作者	Yu, Jingyi
作者单位	1.Chinese Acad Sci, Shanghai Inst Microsyst & Informat, Beijing, Peoples R China 2.ShanghaiTech Univ, Shanghai, Peoples R China 3.Univ Chinese Acad Sci, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 5.Chinese Acad Sci, Shanghai Inst Tech Phys, Beijing, Peoples R China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
推荐引用方式 GB/T 7714	Zhu, Yu,Li, Shiying,Luo, Xi,et al. A shared augmented virtual environment for real-time mixed reality applications[J]. COMPUTER ANIMATION AND VIRTUAL WORLDS,2018,29(5).
APA	Zhu, Yu.,Li, Shiying.,Luo, Xi.,Zhu, Kang.,Fu, Qiang.,...&Yu, Jingyi.(2018).A shared augmented virtual environment for real-time mixed reality applications.COMPUTER ANIMATION AND VIRTUAL WORLDS,29(5).
MLA	Zhu, Yu,et al."A shared augmented virtual environment for real-time mixed reality applications".COMPUTER ANIMATION AND VIRTUAL WORLDS 29.5(2018).