Tag: chatgpt
-
Let’s evaling
Last Friday I had a shower thought about evals. An eval is a repeatable experiment on an LLM system: fixed inputs, one or more variants under test, and a scoring rule that turns outputs into numbers you can compare. That’s what Claude tells me anyway. evaling can help you if you’ve ever changed a prompt…
