zc277584121/msmarco-context-relevance-with-think
Viewer
• Updated
• 262k • 15
Cheney Zhang
zc277584121
AI & ML interests
None yet
Recent Activity
commented on an article about 1 month ago
How We Built a Semantic Highlight Model To Save Token Cost for RAG reacted
to
their post with 🚀 about 1 month ago
We've open-sourced a bilingual Semantic Highlighting model that can power multiple production scenarios:
1) RAG Answer Highlighting — Automatically highlight the exact sentences that answer user queries, improving interpretability and helping users quickly locate relevant information.
2) RAG Noise Filtering — Prune irrelevant context before sending to LLMs, achieving 70-80% token cost reduction while improving answer quality by letting the model focus on what matters.
3) Search System Highlighting — Add semantic highlighting features to recommendation systems, e-commerce search, or any retrieval system where users need to see why a result is relevant.
Try it out: https://huggingface.co/zilliz/semantic-highlight-bilingual-v1
Read our article: https://huggingface.co/blog/zilliz/zilliz-semantic-highlight-model
reacted
to
their post with 🔥 about 1 month ago
We've open-sourced a bilingual Semantic Highlighting model that can power multiple production scenarios:
1) RAG Answer Highlighting — Automatically highlight the exact sentences that answer user queries, improving interpretability and helping users quickly locate relevant information.
2) RAG Noise Filtering — Prune irrelevant context before sending to LLMs, achieving 70-80% token cost reduction while improving answer quality by letting the model focus on what matters.
3) Search System Highlighting — Add semantic highlighting features to recommendation systems, e-commerce search, or any retrieval system where users need to see why a result is relevant.
Try it out: https://huggingface.co/zilliz/semantic-highlight-bilingual-v1
Read our article: https://huggingface.co/blog/zilliz/zilliz-semantic-highlight-model
Organizations
