Focusing on what matters: attention

Focus more on what matters

Picture reading a long sentence.
Do you look at every word equally?
No.
To understand the word you are on,
you give more attention to the important ones beside it.
For instance, to understand 'sat'
you look at 'cat' for who sat,
and at 'mat' for where they sat.
Focusing more on what matters is the first step.

Tap a word in the sentence. The words most relevant to it grow bold, showing where the current word focuses.

Tapping a word changed how dark the others looked.
The darker words
are the more important ones to the current word.
The faded words barely matter.
People do this too when reading.
Looking at everything equally is exhausting,
so we pick out only what matters and look harder.
But what counts as important
is not decided on its own.

Context decides the meaning

Sometimes the same word changes its meaning.
What decides that meaning?
The surrounding words, that is, the context.
Think of the word 'bank'.
With 'river' beside it, it means a riverside,
and with 'money' beside it, it means a bank.
The word itself stays the same,
but the reading changes as the surroundings change.
Attention reads these surroundings to decide the sense.

Keep the middle word fixed and tap to swap the context word beside it. The same word flips its reading from riverside to bank.

Just one word beside it changed,
yet the whole reading flipped.
A word does not hold all its meaning alone.
Only in company with its surroundings does it sharpen.
That is why attention matters.
Depending on whom the current word focuses on,
the same word reads as a different sense.
Where this shows up most clearly
is a word with several meanings, an ambiguous word.

Ambiguous words: the coordinate moves with context

We said earlier a word is a coordinate of meaning.
An ambiguous word straddles two places.
Think of 'Apple'.
It sits in the fruit neighborhood and the company one.
Alone, you cannot tell which.
But put 'eat' beside it
and the coordinate is pulled toward fruit,
put 'stock' and it is pulled toward the company.
Context settles a blurry coordinate onto one side.

Tap 'eat' or 'stock' to attach it beside 'Apple'. The meaning coordinate moves between the fruit and the company neighborhoods.

You saw the coordinate move with context.
The same 'Apple',
yet one neighbor word swung its place sharply.
This is the heart of what attention does.
It takes a blurry word's coordinate
and, by focusing on nearby words, pulls it to one side.
So how is the focus shared out?
Equally among all neighbors?
No. More goes to the more relevant side.

Share out focus as weights

We said focus is not split equally.
More relevant words get a larger share.
This share is called a weight.
The key is that all these weights
are divided so they add up to exactly one.
If one side takes a lot,
the other sides take that much less.
Since total focus is limited,
you are choosing where to spend more of it.

Tap a word's bar to give it more focus. When one word takes more, the rest shrink, so the weights always keep summing to one.

Pouring focus into one word
made the others give way by the same amount.
The sum stayed at one throughout.
These shared weights
decide which word to look at and how much.
A word that gets a big weight
pulls harder on the current word's meaning.
That is why 'Apple's coordinate
moves toward the neighbor with the bigger weight.

Let's wrap up

Gathered on one line, it is this.
Reading a sentence, we do not see every word equally.
We focus more on the words important to the current one.
That focus is split into weights,
divided so they add up to one.
The surroundings, the context, decide the meaning.
So 'Apple' can be a fruit or a company.
An ambiguous word's coordinate moves with context.
This focusing on what matters is attention.

Tap the key points in order to review. (focus on what matters -> context decides meaning -> ambiguous coordinate moves -> weights sum to one)

Now you know what attention is.
Not seeing every word equally,
but picking out and focusing on what matters,
this simple idea lets context decide an ambiguous word's sense.
It is striking how the same word
comes alive with a different meaning by its neighbors.
This idea, focus on what matters,
quietly holds up the clever machines
that handle language today.