The big picture
The eight ideas, in order.
| Idea | Remember |
|---|---|
| A rule or a pile | A written rule and a pile are measured the same way. Close counts can hide different mistakes. |
| Keep some back | A split makes the learn set and the kept-back set. Crates it never saw test it fairly. |
| Right out of how many | Walk the guesses and the real words together. Add one on each match. |
| Split it differently | Move the split and the count moves. The count and the size of the test set are reported together. |
| Learning the examples | A nearest-example program is right about crates it holds. That is automatic. Only a new crate can surprise it. |
| Ask more than one | Three nearby examples can outvote one odd example. More examples do not always help. |
| The order you do it in | Split, then learn, then measure on the kept-back part. Measure on what it learned from and the count flatters. |
| Write the rule yourself | Walk the examples, carry the nearest so far, hand back its word. |
You built a program and a count. The count says how often the program is right.
Next: Using AI Well & Safely I.