Shauli Ravfogel Title: Unsupervised Distillation of Syntactic Information From Contextualized Neural Representation. Abstract: Contextualized word representations, such as ELMo and BERT, were shown to perform well on a various of semantic and structural (syntactic) task. In this work, we tackle the task of unsupervised disentanglement between semantics and structure in neural language representations: we aim to ... Read more