July 5, 2026blog

One-Shotting a Grading Rig with Fable

Exercising Fable with a project that touches the real world

Like the rest of the world, I am very impressed by the long-term capabilities of Anthropic’s latest model. Having a little usage to spare, I decided I would try it on a cute little idea that I have been sleeping on.

The idea: a fixed camera and a projector, both pointed down at a paper jig on my desk. Drop a handwritten exam answer into the jig, a local VLM grades it, and the projector draws the marks — ticks, the score, a one-line remark — back onto the paper, registered to the right spot on the page. I wrote a spec, handed it to Fable, and asked it to produce a working MVP. The whole thing came together in a single conversation.

What Fable can do

On its own initiative, Fable did some impressive things that I wouldn’t have bet an AI would be able to do:

  1. Calibrated the jig by superimposing a grid and reading off the coordinates.
  2. Calibrating the projector by projecting dots and differencing frames to find them.
  3. Generating its own synthetic test data with realistic transforms.
  4. Debugging a MacOS window-handling issue.
  5. Figuring out color-channel issues

It worked autonomously for about forty minutes, and had a working prototype. It built the product up by layer by layer, instead of all at once, and built up a set of experiments and tests to validate at each step of the way.

One live grade, end to end: blank the projector and capture, flatten the page with a homography, crop to the known answer box, grade it with a local VLM, render the annotation in paper coordinates, then warp that onto the projector so it lands on the page.
One live grade, end to end: blank the projector and capture, flatten the page with a homography, crop to the known answer box, grade it with a local VLM, render the annotation in paper coordinates, then warp that onto the projector so it lands on the page.

My hands

My contribution to the endeavour was the design and assembly of the jig, some mild discussion in writing the spec, and swapping in pages on request.

The full source is on GitHub, and Fable’s own unedited writeup on the session is fascinating. It almost (but not quite) thinks like a human would.

The rig grading a real page, hands-free: present the paper, the marks land back on it.