dc.date.accessioned | 2018-10-18T12:22:00Z | |
dc.date.available | 2018-10-18T12:22:00Z | |
dc.date.created | 2017-05-10T18:29:20Z | |
dc.date.issued | 2017 | |
dc.identifier.citation | Kutuzov, Andrei Lison, Pierre . Redefining Context Windows for Word Embedding Models: An Experimental Study. Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017. 2017, 284-288 Linköping University Electronic Press | |
dc.identifier.uri | http://hdl.handle.net/10852/65204 | |
dc.description.abstract | Distributional semantic models learn vector representations of words through the contexts they occur in. Although the choice of context (which often takes the form of a sliding window) has a direct influence on the resulting embeddings, the exact role of this model component is still not fully understood. This paper presents a systematic analysis of context windows based on a set of four distinct hyperparameters. We train continuous Skip- Gram models on two English-language corpora for various combinations of these hyper-parameters, and evaluate them on both lexical similarity and analogy tasks. Notable experimental results are the positive impact of cross-sentential contexts and the surprisingly good performance of right-context windows. | |
dc.language | EN | |
dc.publisher | Linköping University Electronic Press | |
dc.relation.ispartof | Proceedings of the 58th Conference on Simulation and Modelling | |
dc.relation.ispartofseries | Proceedings of the 58th Conference on Simulation and Modelling | |
dc.rights | Attribution-NonCommercial 4.0 International | |
dc.rights.uri | https://creativecommons.org/licenses/by-nc/4.0/ | |
dc.title | Redefining Context Windows for Word Embedding Models: An Experimental Study | |
dc.type | Chapter | |
dc.creator.author | Kutuzov, Andrei | |
dc.creator.author | Lison, Pierre | |
cristin.unitcode | 185,15,5,56 | |
cristin.unitname | Forskningsgruppen for språkteknologi | |
cristin.ispublished | true | |
cristin.fulltext | original | |
dc.identifier.cristin | 1469441 | |
dc.identifier.bibliographiccitation | info:ofi/fmt:kev:mtx:ctx&ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.btitle=Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017&rft.spage=284&rft.date=2017 | |
dc.identifier.startpage | 284 | |
dc.identifier.endpage | 288 | |
dc.identifier.pagecount | 337 | |
dc.identifier.urn | URN:NBN:no-67735 | |
dc.type.document | Bokkapittel | |
dc.type.peerreviewed | Peer reviewed | |
dc.source.isbn | 978-91-7685-601-7 | |
dc.identifier.fulltext | Fulltext https://www.duo.uio.no/bitstream/handle/10852/65204/1/Redefining-Context-Windows-for-Word-Embedding-Models.pdf | |
dc.type.version | PublishedVersion | |
cristin.btitle | Proceedings of the 21st Nordic Conference on Computational Linguistics, NoDaLiDa, 22-24 May 2017 | |
dc.relation.project | NFR/231211 | |