Embedding
Category: science
A method for representing unstructured data (like words) as numerical vectors.
Words are just tokens; computers don’t know what "insurance" means. An embedding translates words into a high-dimensional space where "insurance" is mathematically close to "risk" and "policy." Embeddings are the secret sauce of all modern generative AI models.
Common Examples
- We utilized a pre-trained word embedding to give our classification model an intuitive understanding of industrial terminology.
- Embeddings are what make large-scale text analysis possible, allowing our search algorithm to find semantically relevant matches in our PDF archives.