Repository navigation
Custom Embedding #29
Answered
by
codelion
BharatSingla12
asked this question in
Q&A
Custom Embedding
#29
|
How can I utilize embedding models other than Hugging Face? For example, how can I use OpenAI embeddings? |
Answered by
codelion
Apr 6, 2025
Replies: 1 comment
|
The adaptive classifier technique works on open models since we need access to the weights to add on an adapter and neural memory. You can see this with some the adaptive classifiers released on HF - https://huggingface.co/adaptive-classifier They will have a small model.safetensors file and a config. The model.safetensors file corresponds to the adapter which is added to the base classifier that is mentioned in the config.json. The examples.json file contains the embeddings corresponding to the neural memory. |
0 replies
Answer selected by
codelion
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The adaptive classifier technique works on open models since we need access to the weights to add on an adapter and neural memory. You can see this with some the adaptive classifiers released on HF - https://huggingface.co/adaptive-classifier
They will have a small model.safetensors file and a config. The model.safetensors file corresponds to the adapter which is added to the base classifier that is mentioned in the config.json. The examples.json file contains the embeddings corresponding to the neural memory.