本地模型路由优化 - #219
Open
yu-zhy wants to merge 2 commits into
Open
Conversation
added 2 commits
July 31, 2026 14:55
新增本地实时主题追踪系统(TopicGraph)和可插拔词典分词器: - Segmenter 接口, 支持多语言扩展 - 中文词典分词(正向最大匹配, jieba 词典), 首次使用自动下载 - POS 词性标注过滤虚词(连词/介词/助词/代词等不纳入关键词) - 单字二元组合并(补偿词典未收录的复合词) - FMM 算法修复: 长词优先(修复前高频短词会错误替换长词) - 安全加固: HTTP 30s 超时, 32MB 响应体限制, 缓存目录 0700 - TF-IDF + 余弦相似度实时追踪对话主题 - 会话侧重点摘要(SessionFocus) - 话题切换检测: 与会话主导话题比对, 区分"切换"与"扩展" - 虚词过滤基于 jieba POS 标注(删除硬编码词表) - 会话隔离: /new 切换时 TopicGraph 自动重建 - segmenter.yaml 独立配置文件(不污染 model.yaml) - language: zh 启用中文词典分词(默认不启用,零开销)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
引入all-minilm-l6-v2进行语义识别替代关键词策略，优化本地模型路由方案
通过/ 预计算的"复杂任务"语义向量(一次性计算，缓存) 来优化路由策略
"重构代码架构", "分析系统依赖关系", "设计模块接口", "排查性能瓶颈", "review代码安全性", "多文件重构", "架构设计" 会路由到pro模型