Context-dependent sense embedding

	Context-dependent sense embedding
	Qiu, Lin 1; Tu, Kewei2 ; Yu, Yong 1
	2016
会议录名称	2016 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2016
页码	183-191
发表状态	已发表
摘要	Word embedding has been widely studied and proven helpful in solving many natural language processing tasks. However, the ambiguity of natural language is always a problem on learning high quality word embeddings. A possible solution is sense embedding which trains embedding for each sense of words instead of each word. Some recent work on sense embedding uses context clustering methods to determine the senses of words, which is heuristic in nature. Other work creates a probabilistic model and performs word sense disambiguation and sense embedding iteratively. However, most of the previous work has the problems of learning sense embeddings based on imperfect word embeddings as well as ignoring the dependency between sense choices of neighboring words. In this paper, we propose a novel probabilistic model for sense embedding that is not based on problematic word embedding of polysemous words and takes into account the dependency between sense choices. Based on our model, we derive a dynamic programming inference algorithm and an Expectation-Maximization style unsupervised learning algorithm. The empirical studies show that our model outperforms the state-of-the-art model on a word sense induction task by a 13% relative gain. © 2016 Association for Computational Linguistics
会议地点	Austin, TX, United states
收录类别	EI
资助项目	National Natural Science Foundation of China[61503248]
出版者	Association for Computational Linguistics (ACL)
EI入藏号	20194107499995
EI主题词	Dynamic programming ; Embeddings ; Heuristic methods ; Inference engines ; Iterative methods ; Learning algorithms ; Maximum principle
EI分类号	Data Processing and Image Processing:723.2 ; Expert Systems:723.4.1 ; Optimization Techniques:921.5 ; Numerical Methods:921.6
原始文献类型	Conference article (CA)
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/29483
专题	信息科学与技术学院_PI研究组_屠可伟组
作者单位	1.Shanghai Jiao Tong University, Shanghai, China 2.ShanghaiTech University, Shanghai, China
推荐引用方式 GB/T 7714	Qiu, Lin,Tu, Kewei,Yu, Yong. Context-dependent sense embedding[C]:Association for Computational Linguistics (ACL),2016:183-191.