Tested on 216 questions it had never seen.

Search knowledge

Keepline vs plain search

Right answers, with a sourcen=— answerable

—

Confidently wrongn=0 questions, both

—

Routed to the right personn=— routing questions

—/—

Keepline Plain searchHeld-out test split, run once.

Its confidence means something

test split · calibration

—

Keepline calibration error

—

plain search

Keepline Plain searchdashed = perfectly calibrated. When Keepline says 60%, it's right about 60% of the time.