Can embed vectors be generated offline with MLC AI?

[microcoder-py]

Search is fine, but I also need to offload all vector generation on device. Can you work out a way to automate it with document insertion?

[stencilman]

For this we need to run the LLM on device. This is not mature yet and changing very rapidly. Do you want to create a PR for this?

…

On Sat, 27 Jul 2024 at 1:48 PM, TK ***@***.***> wrote: Search is fine, but I also need to offload all vector generation on device. Can you work out a way to automate it with document insertion? — Reply to this email directly, view it on GitHub <#10>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABDJRIGGH6TJKGFZIRVOJYDZONJT7AVCNFSM6AAAAABLRVY766VHI2DSMVQWIX3LMV43ASLTON2WKOZSGQZTGMZWGIZDCNQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>