Context-dependent sense embedding
2016
会议录名称2016 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2016
页码183-191
发表状态已发表
摘要Word embedding has been widely studied and proven helpful in solving many natural language processing tasks. However, the ambiguity of natural language is always a problem on learning high quality word embeddings. A possible solution is sense embedding which trains embedding for each sense of words instead of each word. Some recent work on sense embedding uses context clustering methods to determine the senses of words, which is heuristic in nature. Other work creates a probabilistic model and performs word sense disambiguation and sense embedding iteratively. However, most of the previous work has the problems of learning sense embeddings based on imperfect word embeddings as well as ignoring the dependency between sense choices of neighboring words. In this paper, we propose a novel probabilistic model for sense embedding that is not based on problematic word embedding of polysemous words and takes into account the dependency between sense choices. Based on our model, we derive a dynamic programming inference algorithm and an Expectation-Maximization style unsupervised learning algorithm. The empirical studies show that our model outperforms the state-of-the-art model on a word sense induction task by a 13% relative gain.
© 2016 Association for Computational Linguistics
会议地点Austin, TX, United states
收录类别EI
资助项目National Natural Science Foundation of China[61503248]
出版者Association for Computational Linguistics (ACL)
EI入藏号20194107499995
EI主题词Dynamic programming ; Embeddings ; Heuristic methods ; Inference engines ; Iterative methods ; Learning algorithms ; Maximum principle
EI分类号Data Processing and Image Processing:723.2 ; Expert Systems:723.4.1 ; Optimization Techniques:921.5 ; Numerical Methods:921.6
原始文献类型Conference article (CA)
文献类型会议论文
条目标识符https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/29483
专题信息科学与技术学院_PI研究组_屠可伟组
作者单位
1.Shanghai Jiao Tong University, Shanghai, China
2.ShanghaiTech University, Shanghai, China
推荐引用方式
GB/T 7714
Qiu, Lin,Tu, Kewei,Yu, Yong. Context-dependent sense embedding[C]:Association for Computational Linguistics (ACL),2016:183-191.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
个性服务
查看访问统计
谷歌学术
谷歌学术中相似的文章
[Qiu, Lin]的文章
[Tu, Kewei]的文章
[Yu, Yong]的文章
百度学术
百度学术中相似的文章
[Qiu, Lin]的文章
[Tu, Kewei]的文章
[Yu, Yong]的文章
必应学术
必应学术中相似的文章
[Qiu, Lin]的文章
[Tu, Kewei]的文章
[Yu, Yong]的文章
相关权益政策
暂无数据
收藏/分享
文件名: 10.18653@v1@D16-1018.pdf
格式: Adobe PDF
文件名: 10.18653@v1@D16-1018.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。