Once you see silver on all the frets you have marked you want to make double sure that they are all the same height. You do this by taking a machine flat straight edge that can span three frets over ALL of them three at a time looking for any that cause it to rock even a little.

If you find that they are all level, my next step is usually to load my plainer/sander with some 320 or 400 grit and touch the tops of the frets with it lightly to cut down on the amount of polish work I have to do later.