semantics. The former are dense and uninterpretable, the latter largely based on familiar,
discrete classes (eg, supersenses) and relations (eg, synonymy and hypernymy). We
propose methods that transform word vectors into sparse (and optionally binary) vectors.
The resulting representations are more similar to the interpretable features typically used in
NLP, though they are discovered automatically from raw corpora. Because the vectors are …