Keep some crates back
The evening pile has 24 priced crates. Which ones should the program learn from?
Loading lab…
Step 1 of 4
- Twenty-four crates, one evening pile.
- Split: every third crate goes to the kept-back pile.
- Learn pile: 16 crates. Kept-back pile: 8 crates.
- The program never sees the kept-back pile.
The rule
Learn from most crates. Keep a few back, unseen.
One split makes the learn set and the kept-back set. A kept-back crate is one the program has never seen. Crates it never saw test it fairly.
- Training data — the learn set. The crates the program is shown.
- Test data — the kept-back set. The crates it never sees.
The score is how many kept-back crates the program guessed right. The lightly marked half is every crate with 7 or fewer marked.
| Split | Learn | Kept back | Score |
|---|---|---|---|
| Every third crate | 16 | 8 | 4 of 8 |
| First eight crates | 16 | 8 | 2 of 8 |
| Lightly marked half | 11 | 13 | 2 of 13 |
The program is the same in every row. Only the split moved. So say how you split, and anyone can repeat the score.
The first eight crates are all full price. The program learns from the other 16. Of these, 12 are cut price. So the program guesses cut too often. It gets only 2 of the 8 right.