Iván Palomares Carrascosa writes about methods for interpreting the dense numerical vector representations, or embeddings, generated by large language models (LLMs). By using a combination of probing classifiers like logistic regression, UMAP dimensionality reduction for visualization, and SHAP values to identify influential latent dimensions, one can analyze the quality and semantic structure captured within LLM-generated embedding spaces.
- Probing classifiers help determine if embeddings are rich enough to distinguish between classes by testing them with simpler models.
- UMAP is used to project high-dimensional embeddings into 2D space for visual inspection of natural groupings.
- SHAP values can pinpoint which specific dimensions in an embedding most significantly influence a classifier's decisions.
- The article demonstrates using Scikit-LLM alongside local Ollama models to generate embeddings cost-effectively.
- Probing classifiers help determine if embeddings are rich enough to distinguish between classes by testing them with simpler models.
- UMAP is used to project high-dimensional embeddings into 2D space for visual inspection of natural groupings.
- SHAP values can pinpoint which specific dimensions in an embedding most significantly influence a classifier's decisions.
- The article demonstrates using Scikit-LLM alongside local Ollama models to generate embeddings cost-effectively.
