b84adacc2f
1. CJK token estimation: replace flat rune_count/3 with script-aware counting — CJK runes (U+2E80–U+9FFF, U+F900–U+FAFF, U+AC00–U+D7AF) count as 1 token each, non-CJK runes at /4. This fixes a 3x underestimate for Chinese/Japanese/Korean text that could incorrectly route complex CJK messages to the light model. 2. Routing observability: SelectModel now returns the computed score as a third value. selectCandidates logs the score on both paths — Info level for light model selection, Debug level for primary model selection. 3. Added tests: TestExtractFeatures_TokenEstimate_Mixed (CJK+ASCII mix), TestRouter_SelectModel_ReturnsScore. Addresses review feedback from @mingmxren. |
||
|---|---|---|
| .. | ||
| context.go | ||
| context_cache_test.go | ||
| context_test.go | ||
| instance.go | ||
| instance_test.go | ||
| loop.go | ||
| loop_media.go | ||
| loop_test.go | ||
| memory.go | ||
| mock_provider_test.go | ||
| registry.go | ||
| registry_test.go | ||
| thinking.go | ||
| thinking_test.go | ||