The scorer on synthetic strokes #3

New issue

Open

opened 2026-10-18 13:14:58 +00:00 by jimmy · 0 comments

jimmy commented

2026-10-18 13:14:58 +00:00

Owner

Part of #1

Goal

Find out if the scorer's verdict matches what a person sees, before the app exists.

Build the scorer as a throwaway on synthetic strokes. Take one exemplar path, and make attempts from it: an exact copy, copies with noise, a copy moved and scaled, a copy that runs backwards, a copy with two strokes in the wrong order, and a copy with one stroke missing. Resample each by arc length, measure the distance with dynamic time warping, and mark the points outside a tube of 8 percent of the x-height. Check the count, the order and the direction as categorical faults.

Done when every bad attempt gets the fault a person would name, every good attempt passes, and the distance ranks the noisy copies in the order of their noise. If the distance does not rank them, try discrete Frechet distance before a stop. Record the tube width that separated good from bad.

Part of #1 ## Goal Find out if the scorer's verdict matches what a person sees, before the app exists. Build the scorer as a throwaway on synthetic strokes. Take one exemplar path, and make attempts from it: an exact copy, copies with noise, a copy moved and scaled, a copy that runs backwards, a copy with two strokes in the wrong order, and a copy with one stroke missing. Resample each by arc length, measure the distance with dynamic time warping, and mark the points outside a tube of 8 percent of the x-height. Check the count, the order and the direction as categorical faults. Done when every bad attempt gets the fault a person would name, every good attempt passes, and the distance ranks the noisy copies in the order of their noise. If the distance does not rank them, try discrete Frechet distance before a stop. Record the tube width that separated good from bad.

jimmy added the

wayfinder:prototype

label

2026-10-18 13:14:58 +00:00

jimmy referenced this issue

2026-10-18 13:15:03 +00:00

The scorer in the app, with the overlay and the faults #8

jimmy added a new dependency

2026-10-18 13:15:27 +00:00

#8 The scorer in the app, with the overlay and the faults