The headset race has 'wear bearing notches'. You can rotate the race or replace. Sometimes repacking will help. The bearings will wear into the race due to the lack of rotation.

Thusly:


Blowing gravel off rural roads