Directional Relations in Complex Word Embeddings

Abstract

We study complex-valued word embeddings where each word is represented by a magnitude and phase. Using a skip-gram objective, the real component captures symmetric similarity while the imaginary component induces directional interactions. Hypernym relations emerge as consistent phase orderings and are sharpened via a lightweight fine-tuning objective, providing a simple geometric mechanism for semantic hierarchy.