Tag: artificial-intelligence
-
Let’s evaling
Last Friday I had a shower thought about evals. An eval is a repeatable experiment on an LLM system: fixed inputs, one or more variants under test, and a scoring rule that turns outputs into numbers you can compare. That’s what Claude tells me anyway. evaling can help you if you’ve ever changed a prompt…
-
It’s back
For a while I thought I’d lost my creativity. Maybe it was the busyness of work or my former employer being acquired in what some might consider a dramatic fashion. I’d stopped programming in the evenings for fun. A few months back I found I felt creative again-partly because of AI tools. A small part…
