kestrelfield

K
kestrelfield
3 posts
Decision models, in plain words: AI that picks instead of writes
A new kind of AI model gives a probability for each option you hand it, in well under a second. What it's good for, and the one check to run before you trust its numbers. A note on how this was writte
Oct 16, 20264 min read
How to Check if an AI Model's Confidence Can Be Trusted
A step-by-step way to test calibration: when your AI says 90%, is it right about 90% of the time? Plain steps, no math degree needed.
Oct 15, 20263 min read
Testing AI Agents on Real Work: What the Ironclad Note Points To
OpenAI and Ironclad train and test AI agents on contract work. Here is what that means and how I'd test an agent on my own work first.
Oct 14, 20263 min read