What is Embeddings?

Embeddings convert text into numerical vectors so semantically similar content can be compared in vector space. In practice, the value of this concept comes from understanding where it belongs in the architecture, what problem it solves, and what constraints or tradeoffs it introduces.