TrackerMetricsreasoning-sec

Reasoning time reasoning-sec

`finished_duration_sec` of the reasoning block (`timing.reasoning_sec`). Measured 22 Aug 2026: standard 1–7 s, thinking 2–6 s on searching questions, 0 without search. The thinking level "medium" thus barely thinks longer than instant. Not to be confused with `timing.total_ms`, which contains the runner choreography and is not compared.

58 data points since 20 Aug 2026 · Download: JSON · CSV

Median across prompts, per mode

03620 Aug 2026: Baseline (extractor, prompt-set, account)instant 20 Aug 2026: 3instant 21 Aug 2026: 3instant 22 Aug 2026: 3thinking 20 Aug 2026: 6thinking 21 Aug 2026: 4thinking 22 Aug 2026: 220 Aug21 Aug22 Aug
instant thinking

Values per prompt

Prompt20 Aug 202621 Aug 202622 Aug 2026
K1-01 instant232
K1-01 thinking676
K1-02 instant33
K10-01 instant21
K11-01 instant34
K11-02 instant3
K13-01 instant54
K14-01 thinking20
K14-02 thinking00
K2-01 instant343
K2-01 thinking796
K2-02 instant34
K2-03 instant52
K3-01 instant47
K3-02 instant47
K4-01 thinking100
K5-01 instant533
K5-01 thinking12206
K5-02 instant35
K6-01 instant221
K6-01 thinking342
K6-02 instant12
K7-01 instant11
K7-02 instant45
K8-01 instant2
K9-02 instant2