Brush all surfaces. After all, I would think the floor is the most important for smoothness.

What I did was start at the top of the wall and brush down and out on the floor the length of the brush in one motion. Saves some time.