Skip to main content
Machine Learning & Deep Learning

⏱ About 10 min10 XP

More Examples, Better Guesses

Imagine you are trying to learn the rules of a new card game. Someone shows you one round and you try to play. You will probably make a lot of mistakes! But after watching ten rounds, you start to understand. After fifty rounds, you are playing pretty well. After a hundred rounds, you feel confident. More examples helped you get better. Machines work the same exact way.

Why More Examples Help

When a machine studies only a few examples, it only sees a small slice of the world. It might learn a pattern that works for those few examples but fails on new ones. Here is an example. Imagine teaching a machine to recognize birds. You only show it pictures of robins — small, red-breasted birds. The machine learns: birds are small and have red chests. Now you show it a penguin. It says: that is not a bird! But it is wrong. Penguins are birds — they just look very different from robins. The machine failed because it did not see enough examples. If you had also shown it penguins, eagles, and flamingos, it would have built a much better picture of what makes a bird a bird.

The Big Idea

More examples show a machine more of the world. The more variety in examples, the better the machine gets at predicting new things it has never seen before.

But here is something important: the examples need to be good examples. If you show a machine 1,000 photos of cats, but all the photos are blurry and dark, the machine learns from blurry, dark pictures. It might struggle when it sees a clear, bright photo of a cat. Good examples are clear, accurate, and varied. They show many different versions of the thing you are trying to teach. Quantity matters — more is usually better. But quality matters too — good examples make good predictions.

Match each situation to what happens to predictions.

Terms

Machine sees only 5 examples
Machine sees 5,000 varied examples
Machine sees 1,000 identical examples
Machine sees examples with mistakes in the labels

Definitions

Predictions may still miss unusual cases
Machine learns the wrong patterns
Predictions become much more accurate
Predictions are often poor and limited

Drag terms onto their definitions, or click a term then click a definition to match.

Think of it this way. If you only ever tasted one type of apple — say, a green Granny Smith — you might predict that all apples are sour and green. But if you tasted red Fuji apples, yellow Golden Delicious, and pink Lady apples too, you would have a much better understanding of apples. Variety in examples teaches the machine the full picture, not just one tiny corner of it.

Quality Counts

One thousand great examples are more useful than one million bad ones. When teaching a machine, good, clear, varied examples matter more than just having a huge pile of data.

A machine learned to predict dogs by studying only pictures of golden retrievers. What will probably happen when it sees a poodle?

Which set of examples would help a machine predict rain most accurately?

More Examples Game

  1. You are going to teach a family member or friend to predict a secret rule.
  2. Pick a secret rule for sorting objects — for example, 'things that fit in your hand' vs 'things that do not.'
  3. Start with just two examples and ask them to predict the next one. They will probably struggle.
  4. Add four more examples. Ask again. Are they getting closer?
  5. Add six more examples. Ask again. Most people get it now!
  6. After the game, talk about: at what point did they figure out the pattern? How did more examples help?