[Fix][Transform-V2] Reduce embedding precision from double to float#9635
Conversation
|
I think we can start by reducing the embedding precision from double to float. The precision loss isn’t just happening with Zhipu—it’s actually an issue with almost all models where the embedding type is returned as double, like
So, as a quick fix, we can switch to float for now and add a note in the docs to let users know. @Hisoka-X |
+1. Next step, we should support double vector type. |
|
Thanks @xiaochen-zhou . Could you add a test case to cover it? |
OK. |
@Hisoka-X @xiaochen-zhou Another question, is there a plan to support multimodal embeddings?https://www.volcengine.com/docs/82379/1523520 |
I think this suggestion is great, and I would be happy to try implementing it. @Hisoka-X |
+1 |


Purpose of this pull request
Reduce embedding precision from double to float,close #9611
Does this PR introduce any user-facing change?
no
How was this patch tested?
Exists tests
Check list
New License Guide